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OPTIMAL CONTROL AND PARAIiBTER DETERMINATION 

IN 

VOLTERRA TYPE INTEGRAL AND DELAY DIFPERENTIAL SYSTEMS 

A wide variety of systems in science and engineering have 
a mathematical representation in the form of a system of Volterra 
type integral equations (VTIE). Dynamical systems represented 
through Delay -Differential Equations (DDE) are abundant in 
Chemical processes, Mechanical and Electrical systems etc.. 
Several researchers have studied the problem of optimal control 
and parameter determination in such systems. 

The first results on optimal control of systems described 
by VTIE were due to Friedman (1964) and were followed by the 
work of Vinokurov (1969). Huang (1972) considered a general 
variational problem in such systems. Das (1967) considered the 
problem of optimal control for a hereditary process with delay, 
in presence of unknown parameters. 

A Pontryagin's maximum principle for systems governed by 
DDE was derived by Kharatishvili (I96l). Numerical techniques 
for the determination of optimal control in DDE have been 
developed by several authors. Eller et al. (1969) have presented 
a technique, that generates an open-loop control, in the case of 



a quadratic cost functional. Slater and Wells (1972) have 
transformed the problem for a linear system, with the cost 
functional quadratic in control but not containing the state 
variables, into an equivalent non-delay problem. Sub-optimal 
controls have been obtained by Inoue et al. (1971), Jamshidi 
et al. ( 1972 ) and Malek-Zava.rei (1980) using a MacLaurin series 
expansion of the control. G-racovetsky and Vidyasagar (1972,1973) 
and Malek-Zavarei (1980) have endeavoured to obtain sub-optimal 
controls, by solving a sequence of optimal control problems 
defined for ordinary differential equations. 

In this work we consider some aspects of the above problems. 

A large portion of the work is devoted to the development of com- 
putational methods, for the determina,tion of optimal control and 
parameters, in systems described by VTIB and DDE, in a determini- 
stic framework. 

Numerical algorithms, based on the quasilinearization tech- 
nique, are developed for the determination of parameters in VTIE, 
minimizing a seminorm. The convergence proofs are given, under 
various system restrictions, for the two algorithms developed. As 
an application of these algorithms the problem of model reduction 
in dynamical systems is solved and various computational aspects 
are discussed. . The method is illustrated by a numerical example. 
Then a set of necessary conditions is developed for optimal 
control of systems described by VTIE with parameters. This 
special treatment results in a compact set of conditions to be 
satisfied by the optimal control and parameters. 



The problem of optimal control of systems described by 
DDE is then considered. An iterative scheme is proposed to 
determine a partly closed-loop and partly open-loop control 
for problems with quadratic cost functional. The convergence 
of the algorithm is established with certain system restri- 
ctions. As an illustration an optimal control policy, for a 
refining plant, to improve the system response is determined 
using the algorithm developed. 

Finally the determination of optimal initial function and 
parameters in a system of DDE is discussed. The initial fun- 
ction is approximated to be contained in a finite dimensional 
subspace of the space of continuous functions and the problem 
is formulated as a parameter determination problem. Conditions 
for existence of a solution to the problem are discussed and a 
set of necessary conditions is developed. A steepest descent 
algorithm is proposed to determine a local solution of the 
problem. The method is illustrated by solving a model reduction 
problem. 



C OFTEFTS 


C Jaap ter I 


Page 


IFTRODUCTIOF 1 

DETEMFITIOF OP OPTIMAL PARAI4ETERS IN 

SYSTEMS DESCRIBED BY VOITERRA TYPE 

INTEGRAL EQUATI ONS 1 4 

1. Introduction 14 

2. General proLlem formulation 15 

3. Linearized, problem 16 

4. Pormulation of tJie first algorithm 

and convergence proofs 17 

4.1 Algorithm (A1 ) [iteration 

method witlaout X -strategy] 21 

4.1.1 First convergence proof for 

algorithm (A1 ) 25 

4.2 Extension of convergence of 

algorithm (A1 ) 28 

4.2.1 Second convergence proof for 

algorithm (A1) 32 

5. Formulation of the second algorithm 

and convergence proof 35 

5.1 Algorithm (A2) [iteration method with 

X -strategy] , 37 

5.1.1 Convergence proof for algorithm (A2) 39 

6. Methods of solving the linear problem 43 

6.1 Problem with known resolvent Kernel 44 

6.2 Problem with degenerate Kernel 45 

6.3 Problem with integral cost functional 46 

Conclusion 47 


7. 



Chapter II OPTIMAL REDUCTION OP DYNAUCECAL SYSTEMS 49 

1 . Introduction 49 

2. Reduction of a general system 51 

5. Reduction of LTIYS 52 

4. Reduction of stable-LTIVS 53 

4.1 Computational aspects 60 

4.2 Numerical example 64 

5. Conclusion 6? 

Chapter III NECESSARY CONDITIONS EOR OPTIMAL CONTROL 
OP SYSTEMS DESCRIBED BY VOLTERRA TYPE 
INTEGRAL EQUATIONS WITH PARAMETERS 69 

1 . Introduction 69 

2. Problem formulation and necessary 70 

conditions 

3. Proof of theorem-1 74 

4. Conclusion ’ 85 

Chapter IV OPTIMAL CONTROL OP SYSTEMS DESCRIBED BY 

DELAY-DIPPERENTIAL EQUATIONS 87 

1 . Introduction 87 

2 . Lemma 90 ' 

3. Problem statement and method of 

■ solution 93 

4. Numerical example 96 

5. Conclusion 102 



Chapter V DETERMINATION OP OPTIMI, INI Till 

PUNCTION AND PARAMETERS IN A SYSTEM 
DESCRIBED BY DEIAY-I" 'I AI 


EQUATIONS 

104 

1 . 

Introduction 

104 

2. 

Existence of solution for 
problem (P) 

106 

5. 

Necessary conditions 

112 

4. 

Numerical example 

117 

5. 

Conclusion 

121 

REPERENOES 

123 



INTRODUCTION 


Optimization theory had its origin in the pre-calculus era . 
Fermat's principle in optics and the isoperemetric problem, 
known as the problem of the Queen of Dido, were formulated 
before calculus was invented. The first results in optimiza- 
tion theory were systematized and brought together under the 
heading of the calculus of variations after the fundamental 
works of Euler (1707-1783). Euler and Lagrange formulated 
general constrained minimum problems and derived the appropriate 
multiplier rulf^s in a formal manner. McShane [l] in his study 
of the Lagrange problem, constructed certain special variations 
which were shown to form a convex set. McShane' s variations 
were used by Pontryagin et al. [2] in their proof of the maximum 
principle. The nature of this condition and the form of the 
optimal solutions are considerably different from the classical 
theorems of the Calculus of Variations and have occupied an 
important position in optimization theory. Starting with the 
basic results of Pontryagin et al. there have been notable 
contributions from a large number of scientists, which provide 
a good insight into the problems of optimization theory. 
Dubovitskii-Milyutin [3] found a necessary condition for an 
extremum in the form of an equation set down in the language 
of functional analysis. They were able to derive, as special 
cases of this condition, almost all previously known necessary 
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conditions. G-amkrelidze [ 4 ] formulated a general ejrtremal 
problem in the theory of differential equations and derived 
necessary conditions, introducing the idea of a quasiconvez 
family of functions. Neustadt [ 3 ] formulated a general 
variational problem and derived necessary conditions, 
introducing the idea of first-order convex approximations - an 
extension of the cone of attainability introduced by 
Pontryagin et al. and the quasiconvexity introduced by 
Gamkrelidze. The Dubovitskii-Milyutin and the Gamkrelidze- 
heustadt approaches differ basically in their treatment of the 
equality constraints. Further extensions and generalizations 
of the above results are being carried over till date. For 
some of the important contributions one can see the references 

[6, 7, 8, 9]. 

Second order necessary conditions for optimization 
problems with constraints were developed by Dubovitskii- 
Milyutin [ 1 0 j . Higher order necessary conditions in a very 
general setting (Ordered Topological Vector Space) were 
obtained by Hoffman et al. [1I] by extending the concept of 
tangent cone used by Dubovitskii-Milyutin etc. Necessary and 
sufficient conditions for optimization problems in a Bannach 
Space with equality and inequality constraints were developed 
by Levitin et al, [12]. 

Economic and application necessities have given rise to 
the development of a vast literature for various specialized 
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problems,. One can broadly view the general discipline of 
optimization theory as consisting of - Mthematical Programming, 
Optimal Control theory and Approximation theory. 

Mathem.atical programming deals with the determina.tipn of 
extrema of smooth functions on closed domains with piecewise- 
smooth boundaries, Pirst results in this direction were obtained 
. by Eantorovich [l3]. 

The problem of Optimal Control relates' to finding the best 
(in some sense or other) among a given class of control functions 
so that a, given process , exhibits a desired behaviour. 

The usual: problem of approximation theory • can be stated as 
follows ; 

let (X,d) be a metric space and Y be a subset, of ■ X. let 
v^GIX be a. given point in X. It is required to find an element 

such that d(v^, Y) attains its minimum among all the points 
in ■ . 

The following problem of optimal parameter determination 
can be thought of as a special problem of Approximation theory ; 

Determine a set of parameters (constants) associated with 
a given system sq that certain system behaviours are best met. 
Here, by a system, we mean the mathematical representation of a, 
physical object. 

One comes across such problems in various areas of applied 
sciences and engineering. Some of these are listed, below ; 



4 


(i) Curve fitting : 

A convenient and comprehensive representation of certain 
tabulated data is to represent it through a function relating 
the dependent and independent variables. One method of 
achieving this is to select a class of functions and choose 
one that best fits the data. 

As an illustration; let the data consist of ; 

i=‘I,2, ...,n;yj^'s are dependent variables and x^'s are 
independent variables. Let the class of functions be given by, 
m 

y(x) = I a^ I x-Xj^l sin mix, m<n 
i = 1 

The values of the parameters, to , a^^,- i = 1,2, ..., m are 
sought so as to satisfy the least square criterion, i.e., 

m 2 

^ ^i^"^ is a minimum. 

i=1 

(ii) Model fitting ; 

The problem of model fitting consists of determining a 

mathematical model of a physical system. In this case the 

scientist is very-often aware of the laws governing the system 

under consideration. He can then describe the relationships 

among the observed quantities. For instance, the voltage 

current relationship for a linear inductor is given by, 

- ^ t . t ~ j (t-s) 
i(t) = i(o) e 1 5 ® ds 

o 
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The problem is to determine the values of R and 1 so as to 
best fit the measured data i(t), tCI.[C)>Tl corresponding to an 
applied voltage v(t), t€n[0,T]. 

(iii) Model Reduction : 

Model reduction comprises of obtaining an approximate 
representation of a complex system that makes it amenable to 
various system manipulations like design of controllers, 
analysis of system performance etc., maintaining permissible 
accuracy. A reduced model is most commonly used while dealing 
with large scale systems, e.g., power system analysis and 
design, process control and instrumentation etc. 

As an illustration, consider the problem of designing 
regulators and stabilizers for a generator connected to a 
power system network. Por this purpose the generator is 
represented by a detailed model while the rest of the network 
is represented by an equivalent approximate model of a small 
order. 

A mathematical formulation of the model reduction problem 
can be stated as follows : 

Let the system under consideration be represented by, 

t 

x(t) = f(t) + I g(t,s, x(s), u(s))ds 

o 

y(t) =G(t, x(t), u(t^, y€:R“^, x€ZR^, 


n 5^ m 
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The problem is to determine the parameters a,b,c in the reduced 
system equation, 

t 

x(t) = f(t,a) + I g(t,s,x(s), u(s), b) ds 

o 

y(t) =G(t,x(t), u(t), c), yCZ xCT n^q^m 

such that pCy-y) is a minimum, p is some given seminorm in 
G^[o,T],* the space of all continuous functions in [0,T] with 

-r,m 

range in R . 

(iv) Input Signal Determination ; 

This problem is frequently encountered in measurement of 
signals. The output of a measuring instrument is a function of 
its system dynamics and the signal being measured. It may not 
always be possible to know the exact value of the signal being 
measured. In such a situation the problem is how to get a 
good approximant. One way of solving this could be as follows 

let the measuring system dynamics be given by ; 

t 

x(t) = f(t, u(t)^+ I g(t,s,x(s) ,u(s) ) ds (iv.l) 

o 

y(t) = C(t,x(t)) 

y is the output of the measuring instrument for a signal u 
applied to its inpux terminals. 

Consider a suitable set of n-linearly independent vectors 

{v^ ; i = 1,2, n} d C^[0,T]. Let u be represented 


approximately by. 
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n 

u(t) = ^ a. v.(t), t£[^[0,T] (iv.2) 

i=1 ^ "" 

Substituting (iv.2) in (iv.l) one gets, 

z(t) = f(t, I v^(t))+ I g(t,s,x(s), I v^(s)) ds 
i=1 o i=1 

y(t) = C(t,x(t)) 

With this the problem reduces to the determination of the 
parameters a^^, i = 1, n such that pCy-y) is minimum- 

Here p, is a suitable seminorm in the appropriate space. 

(v) Control Problems : 

The optimal control problem can be treated within the 
parameter determination framework in special cases. In case 
the class of control functions depend on a finite number of 
parameters (i.e. it is assumed sufficiently smooth) the 
problem of optimal control reduces to the determination of 
parameters minimizing certain performance index associated 
with the problem. 

As an illustration consider the following problem of 
programmed motion : 

For the system in figure ~ 1 , the controller parameters 

a are to be chosen so that the system output x(t) follows a 
prescribed trajectory r(t), t^[0,Tj as closely as possible. 
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A natural formulation of this problem would be to determine 

in 

a^ R , so as to minimize |[e|I subject to the constraint, 

t 

e(t) = r(t) " I exp[A(t-s)] G(a,e(s)) ds 

o 

A - is the constant system matrix. 

The problem of optimal control and parameter determination 
in systems described by Ordinary Differential Equations (ODE) 
has been understood and analysed to a fairly high degree of 
perfection. 

A wide variety of systems in science and engineering have 
a mathematical representation in the form of a system of Yolterra 
Type Integral Equations (YTIE). The above examples illustrate 
few such systems. A comprehensive list of systems represented 
by YTIE is given in [16]. Dynamical systems represented through 
Delay-Differential Equations (DDE) are abundant in Chemical 
processes. Mechanical and Electrical systems etc. 

Kharatishvili [44] have developed a maximum principle 
for optimal control of systems described by DDE. Optimal control 
of systems governed by YTIE were first considered by Friedman[27] • 
Yinokurov [28] has considered the optimal control problem for 
YTIE with restricted phase coordinates. Huang [ 29 ] has consi- 
dered more general variational problems and optimal control 
problems for a system of YTIE with and without restricted phase 
coordinates. He has derived a general maximum principle for such 
problems based on the multiplier rules developed by Heustadt [6]. 
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Das [ 30 J has considered the problem of optimal control of a 
class of VTI3 with constant time lag and parameters. 

One area of optimization theory which has received consi- 
derable attention, since the advent of high speed digital com- 
puters, is the numerical computation of the optimal solutions. 

A number of iterative schemes have been and are being proposed 
for the computation of the optimal solutions, loosely speaking, 
all the* available methods can be classified in to two categories 
[ 17 ] : namely, (i) direct methods and (ii) indirect methods. In 
the direct methods the cost functional is minimized throiigh an 
iterative scheme (e.g., the gradient method, penalty function 
approach etc.). Most of the indirect methods are essentially 
methods for the solution of the necessary conditions of optima- 
lity. 

Gradient methods for determination of parameters and ini- 
tial conditions for systems described by ODE are discussed by 
Bard [20j, Junkins [21 J etc. A quasilinearization technique 
for the determination of parameters and initial conditions, 
minimizing a seminorm by the direct method , is considered by 
Hoffman et al. [iSJ for systems described by ODE. 

The numerical determination of the optimal control in 
systems governed by DDE is considered by several authors. 

Eller et al. [31 J have presented a technique for solving the 
optimization problem with a quadratic cost functional. Slater 
and Wells [33J have considered the problem for linear time delay 



systems with, a quadratic cost functional involving only the 
control. A continuation or sensitivity approach is used by 
Inoue et al. [34] to determine sub-optimal controls for sta- 
tionary systems with small delay in state. Jamshidi et al.[35] 
have expanded the control in a Maclaurin series and obtained 
the series coefficients from non-delay computations for a 
stationary linear system with delay. The result has been 
extended to multiple delays in state and control by Malek- 
Zavarei [36] . 

In this thesis we consider some aspects of the optimal 
control and parameter determination problems for systems des- 
cribed by VTIE and DDE. A large portion of the work is devoted 
to the computational aspects of the problems in a deterministic 
framework. The first three chapters deal with systems described 
by VTIB and the last two chapters with systems described by DDE. 

In Chapter 1 numerical algorithms, based on quasilineariza- 
tion technique, are developed for the parameter determination 
problem. The system equations are considered to be VTIE and the 
minimizing functional - a seminorm. This is a fairly general 
setting and can be applied to determine optimal parameters in a 
large class of practical problems. The convergence proofs are 
given for the two algorithms developed, under different restri- 
ctions on the system equations. It is seen that the first al- 
gorithm is quadratics lly convergent and requires much less com- 
putational effort in each iteration as compared to the second 
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algorithm but it imposes more constraints in the system equa- 
tions, there by restricting it to a smaller class of problems - 

In Chapter 2 the optimal model reduction problem is for- 
mulated to fit into the framework of the approximation problem 
considered in the previous section. The methods of solution for 
various system structures are discussed. This approach covers 
a large class of systems and simultaneously provides an easy 
way out from the difficulties arising in Wilson's [24-] method 
for linear time invariant systems. 

In Chapter 3 a set of necessary conditions are developed 
for optimal control of systems governed by VTIE with parameters. 
This special treatment results in a compact set of conditions 
and provides an insight in to this particular problem. 

In Chapter 4 we consider the optimal control problem in 
systems described by DDE, An iterative scheme is presented 
to obtain a partly closed-loop and partly open-loop control for 
systems with delays in state variables. The works of Gracovetsky 
and Vidyasagar [38,59,40j and Malek-Zavarei [37j deal with 
similar problems. They have endeavoured to obtain sub-optimal 
controls of similar structure. The scheme presented in this 
section is easy to implement and gives an optimal control. The 
convergence proof utilizes a smallness condition. But, as it 
can be seen from the example considered, the method works even 
when the conditions are far from being satisfied. 
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Finally in Chapter 5 the problem of optimal initial 
function and parameter determination is considered for a system 
of DDE. To begin with, existence of a solution for the optimi- 
zation problem is established. A set of necessary conditions 
is then developed in the form of a boundary value problem. A 
steepest descent algorithm is presented to obtain a solution 
using the set of necessary conditions. 



CHAPTER I 


DSTSRMIMTION OP OPTIMI PARAMETERS IN SYSTEMS 
DESCRIBED BY 70LTBRRA TYPE INTEGRAI 

EQUATIONS 


1 . INTRODUCTION 

The usual problem of Approximation Theory can be stated 
as follows : 

Let (X,d) be a metric space and VdX be a subset of X. 
let be a given point in X. It is required to find an 

element V 3 — 

d(xQ,v*) ^ d(xQ,v) 

The development of any computational method for the solu- 
tion of this problem greatly depends on the nature of the space 
(X,d) and the set Y. The work here is devoted to the develop- 
ment of numerical algorithms ' in the case X is restricted to the 
space of all continuous functions in [Oi,l] with range in R^ and 
with the metric a seminorm. Further the set V is restricted to 
the set of solutions of a system of Volterra Type Integral 
Equations (YTIE) with parameters. 

The algorithms developed are based on continuous lineari- 
zation of the integral equations and the solution of the linear 
approximation problem. The basic idea in this is the quasi- 
linearization technique due to Bellman and Kalaba [iS], Hoffman 
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and Klostermair [l9] have given the convergence proofs for 
these algorithms in case the set Y is restricted to the set of 
solutions of a system of Ordinary Differential Equations with 
parameters. The extensions carried over here covers a much' 
larger class of systems. 

The algorithms can he conveniently used to solve a large 
number of problems in physics, engineering, bio-sciences etc., 
which require the determination of certain system parameters. 

Section 2 contains the general problem formulation. The 
linearized problem is stated in Section 3. In section 4 we 
formulate the first algorithm (without X -strategy) and give its 
convergence proofs. Section 5 contains the formulation of the 
second algorithm (with x-strategy) and its convergence proof. 

In Section 6 we give methods of solution of the linearized pro- 
blem in a few special cases. In the last section (Section 7) 
we present some discussions. 

2. GENERAL PROBLEM FOR^CTLATION 

Let h ; [ 0, 1 ] X R^ X R^ X R^ -> R^, q Cl ® ^ 

given. Further let T ; C^[o,l] C^[0,l] be a linear operator. 

Here C^[o,lJ denotes the space of all continuous functions on 
[0,lj with range in R^. 

A solution x*(. I p*, (3*) of the integral equation. 

t 

x(t) = h(t ,x(t) ,p, p) = f(t,p) + J g(t,s,x(s),P) ds (2.1) 

6 

is sought, so that P(q - T x*) is a minimum, under all the 
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solutions x( . I of the equation (2.1). Here P is a semi- 

norm in C^[ 0, 1 ] . 

In future the above problem will be assumed to have the 
following form ; 

t 

x(t): = P(x,ii)(t) = f(t,p) + f g(t,s,x(s)) ds 

o 

F • C^[0,1] X C^[o,lj be a Frechet differentiable 

mapping and the derivative of F at (x,p) will be denoted by 
F' (x,p). 

let ACrP be convex. Define, 

BCC^[0,1] X bP as B*. = C^[0,l] x A 

Problem (GP) ; 

Minimize P(q - T x) 

(x,p)CB /V X = F(x,p) 

3. LINEARIZED PROBLEM 

Let (x,Ti)CB. Linearize F at (x,!!) and set, 

t 

F (x, ^)=f (t,il) + (^^ - 1~) + I g(t,s,x(s)) ds 

(x,ro t ° 

^ j 3g( , t,sA(sj) 
o 

The linearized problem at (x,p) denoted by 
written as follows ; 

(LP^~ ~ ^ ) Minimize P(q - T x) 

(x,p)CB A X = p (x,p) 

(5,ri) 
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4. FORMULATION OP THE FIRST ALGORITHM AND CONVERGENCE PROOFS 

For the formulation of the algorithm and proof of its 
convergence the following assumptions are used : 

Assumption (7i.a) i f is continuous and defined -^/-tCIR 

Assumption (v'l.b) ; For each constant K > 0 and each bounded 
SCR^ 3 a measurable function K(t,s) 13— 

|g(t,s,x) ~g(t,s,y)| ^ K(t,s) I x-yl , wherever 
0 ^ s t ^ K and both x and y are in S. 

For each td [0,K] the function K(t,s) is in L^(0,t) as a fun- 

t+r 

ction of s and Lim f K(t4-rj,s) ds = 0. 

r^ o ^ 

(This is obviously the case if K(t,s) is - integrable in the pro- 
duct space, by Pubini's Theorem). 

(Here | . | denotes the Euclidean norm) 

Further , 

1 

j Sup. K(t,s) ds exists. 

0 tC[o,i] 

Lemma. - 1 : 

(i) V- (x,[i) €1. B 3 (x,p)s: B 3~ 

X = F(x,p) and 1| x-x | | e^ } | x - P(z,ii)|| 

1 

where L = I Sup. K(t,s) ds 

° tC[o,ij 

(ii) V" (^>p)^=I B,^(x,p)C: B 3(x,p)CB 13- 

X = P and I I x-i 1 1 e | | x - P (=!:, n) | | 

i (^,ro (s.p) 
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Proof s (i) 


Consider any (x,^)^ B. 

3 (x, (i) c B 3- ■ ^ 

I I x-x| I , I |f (t , lO + y g(t,s,x(s) ) ds - x(t)| I 


(Here , II ' II . denotes norm in C^[o,t]) 

^ t ^ 

= ((f(t,ii) + f g(t,s,x(s)) ds - x(t) 


+ J [g(t,s,x(s)) g(t,s,x(s))j ds 


I I X - P(x, lO I I + ^ K( t , s ) I I x~x| I _ ds 

o 


Applying Gronwall's lemma ; 

I I X - x| I $ I I X - P(x, lO I I 
Proof : (ii) 

The proof follows by replacing F(x,p) by P (x,p) in the 
above proof. 


(i) V" K > e^C 

inf. { P(q“Tx) + K | |x ~ F(x, p) | | : (x, p) d B } 
= inf. ■fp(q~T x) : (x,[i)£B, x = F(x,p)} 
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(ii) V' K > e^C V~(x,'[I)C:b 
P( q-T x) + K I i X - ^(x,]!) I I 

= inf. {P(q~T x) + K I !x - P(x,^)| | : (x,ii) Cl B } 

<=r=r> (x,\i) minimal solution of (GP) 

(iii) Similar statements are valid for problem (PP^~ ) f 

(x,Ti) €1 B ; i.e. , 

(a) V K > e^C 

inf. ^ P(q--T x) + K [ |x-F (x» p) | | : (x, ii)d B } 

(2,ro 

= inf. {P(q-T x) : (x,p)Cl Br x = F (x,(i)} 

(x, p) 

(b) V- K > e^C Y- ^ B 

P(q-T x) + K I I X - F (x,Ti) ! I 

(x,p) 

= inf. {p(q~T x) + K [ |x--F (x,p)|| ; (x,p)<£l B} 

(x,T0 

<•===> (x,p) minimal solution of (BPj'~ Jj,) ) • 

Here, C; = sup. {P(T x) : x€;C^[o,l], | jx || = 1 } 

Proof : 

Proofs for (i) and (ii) are given here and (iii) follows in 
a similar manner. 

(i) First consider the proof for ' ' 
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inf. f P(q-T x) + K) [ x-P(x,ix)| I i (x,ii)eB} 

« inf. { P(q-T x) + K I lx-P(x,(i)| t (x,[i) €1 B, x = B(x,ti)} 

^ inf. { P(q-T x) : (x,ii) ^ B, x = P(x,ii) } 

Next we prove ' ^ ' 

inf. {P(q~T x) ; (x,(i)^B, x = P(x,ii)} 

^ inf . { P(q-T x) : (x,p)^B, (x,]!)^ B, x = B(x,'il) , 

1 |x -<• X I I e^ ri X - P(x, lO 1 I } 

;< inf.{ P(q~T x) ~ P(T(x-x))+ C llx~xlh (x,p)CB, 

(x, p) C B, X = P(x, \i) , I !x~x 1 I < e^ II x~P(x, p) I 1 > 
^ inf . ■f P(q~T x) + C 11 x-x II: (x, p) €1 B, (x, p) B, 

X = P(x, p) , I I x-x 11^ I I x-F(x, IJ.) I I ) 

^ inf . { P(q-T x) + C e^| | x-P(x, p)| | : (x, p) C B > 

< inf. {P(q-T x) + K | | x-P(x, p) I I ; (x, iO ^ B } 

(ii) ' =>' 

inf. ^P(q'-T x) + K ||x-P(x,^)|j : (x,p)CI B} 

= P(q-T x) + K I I X - P(x,p) ! I 

= P(q-T x) + Z I I X - P(x,p) I I + (K~K) | | x-P(x,II) | | 

(Here K is defined as e^C < Z < K) 

^ inf. {P(q-T x) : (x, p) ^ B, x = P(x, p) } 

+ (Z - Z) I |x - F(x,'[I) 1 I , 
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(by (i)) 

= inf. { P(q-T z) + K I lz-P(z,^i)| |: {x,\i) 0 B} + 

+ (K-K) i I z “ F(x, (i) II 

=^->X = P(z,li) 

==::i>P(q-T z) = inf. { P(q~T z) ; (z,ii)CB, z = F(z,ti)} 
==>(z,|i) minxmal solution of (GP) 

4.1 ALGORITHM (A1 ) : [iteration metiiod without X-strategy} 
Start : Choose ^ ^ ^ B 

Iteration step : is already constructed. 

Construct as the minimal solution of the 

linear approximation problem (IP / . /.\) 

It is assumed that such minimal solution exist. 

For convergence proof, in addition to the assumptions (Vi), 
the existence of a local minimal solution (x*, p*) of (GP) with 
the following properties is essential : 

Assumption (V2) ; (x*, p*) is a strongly unique local minimal 
solution of (GP) if the following holds ; 

f”.. 

Let {x* , p‘*^)'6I B ^ z* = F(x*,p*) then 

36^ > 0, > 0 3— (x,p) ^ B A ||x«x*}| ^ 5^ A 

X = F(x, p) => 

P(q-T x) - P(q~T x*) > | | x - x* | | 
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lemma 2 : 

Assumption A ||x-x*M ^.6^/2 

P(q~T x) - P(q-T x*) + j |x ~ P(x,p)||^K;^ I ! x-x* || 
where K 2 = (C + ) e^. 

Proof : 

By Lemma ( 1 • i ) 

U (x,li) ^ B with X = P(x,p) and I ! x--x I l< e^ I I x-F(x,p) I I 
let I I x~x* 11^6^. Then by Assumption (V2), 

1 I x-x*| 1 ^ ( i 1 x-xi I + I I x-x*l I ) 

I I x~xl I + P(q--T x) - P(q~T x"^ ) 

e^ I I x-F(x, p) I I + P(q-T x) + P(T(x-~x) ) - P(q-T x"^) 

^ 11 x-F(x, p) 11+ P(q-T x) - P(q-T x*) + C | | x-x | | 

,<(K^+C) e^ I I x~P(x,p)|| + P(q--T x) - P(q-T x^') 

= Z 2 I jx~F(x, p) I I + P(q-T x) - P(q-T x*) 

Suppose II X - x"^ I |> 6^ 

I I X ~ x^ I l|x-i|| = I I x-i|| + P(q-T X*) - P(q-T X*) 

^ I I x-x 11+ P(q-T(x*~x+x) ) - P(q-T x*) 

||x-x 11+ P(q-T x) - P(q-T x^ ) + P(T(x-x*)) 

^ I I x-x 1 1+ P(q-T x) - P(q-T x*) + C | | x-x* | 1 

^(Z^+C)e^j| x-P(x,p)]| + P(q-T x) - P(q- T 'x*) 

= Z 2 ||x-P(x,p)|| + P(q-T x) - P(q-T x*) 



lemma 3 : 


Assumption iY2) and convexity of B ==.> V^(x, p) B, 

P(q-T x) - P(q-T x^) + I I x-P (x,p) || 5- 1 ! x-x* | [ 

(x^,p^) 


Proof : 


let 


XX + (l~x)x^ = X* + x(x-x*) 


and \i^ ; = p* + 

For sufficiently small X > 0 lemma -2 and convexity of 


B 


P(q-T x^) - P(q-T x*) + ll^A “^'(2x.Px)ll ^ I I \ \ 

r.-— > XP(q-!r x) - XP(q-T x*) + K 2 | | x^ -PC Xj^ , Pj^ )| I > A || x-x^ 

P(q-T x) - P(q-T x*) + Z^ l{x-P(x*,p*) - 

P(x^ , p-,^) ~ F(x^ , p*) 


Z, ( I x-x"* 




=>P(q~T x) - P(q~T x*) + Z^ |Ix-P(x*,p*) - (p-l^'') 

J ^(t,s,x*(s))(x~x*)g ds I |5- 11 x-x* 1 1 

=:>P(q-T x) - P(q-T x*) + Zp H X-P (x,p)Il ^ | 1 x-x* M 

(x*,p*) ^ 

Assumption (V3.a) : f is linear in p. 

Assumption (V3.b) : let ^ ^2 ^ ^ measurable function 

3 — 

| ?S(t,S.a . 3 )) _ ^(t,s,x(s))| li.^l 

9 3C 9 X S 

A/- ( X , p) Cl B A ( X , p) d B , wherever 1 | x-x* I 6^ A 1 I x-x* I I 
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Lemma -4 : 

From Assumptions (V3) and convexity of B it follows that 
-V- (x,4) .eB, (x,p) £: B ; 

I 1 x~x* 1 1 ^ 62 A II x~x* 1 U 62 

l|F(x,p) - F (x,p) 11^ i ||x-x||^ 

(x, p) 


where 1^ = Sup 


Sup. ^ K(t,s) ds 

te:[o,i] ° 


Proof : 


Define x, ; = x + X(x~x) 

^ t 

(F(x,ii) - F (x,p))(t) = f(t,p) + / g(t,s,x(s)) ds - f(t,p) 

(x,fl) o 


_ |i(t,p) „ j g(t,s,x(s)) 


( lg.(t,s,x(s) )(x-x) ds 
: 9x ® 


J [g{t,s,x(s)) - g(t,.,x(3))] ds - ; (x-x)^ ds 


J / M(‘t»s,Xj^(s) ) (x-x)g ds dX _ I M.("t>s,x(s) ) (x-x)^ ds 

9x 3x 

0 o o 


J J r |£(t,s,x^(s)) _ |_£{t,s,x(s))j 

9 X 9 X s 


0 0 
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1 t 


((F(x,ti) - F (£,ti)|[ ^ Sup. J J I 

(x, p) ^ tf:„ [ o, 1 ] 0 O 

Is. (t ,s,x(s) ) |ds. dX||x-x II 
8x 

11- 

Sup I J K(t,s) |xx - x| ds dX 

tC[0,lJ Q Q 

1 1 


^(t ,s,x^ (s) ) 
8x ^ 


I X--X 


^ Sup r ^ f - 2 

tCLO,lJ •' ^ E:(t,s) ds dX I f x~x I I 

0 0 


i II x-x| I 


2 


4.1.1 FIRST CONVERGEECB PROOF FOR ALGORITHM (A1 ) : 
Theorem- 1 % 


Let A be convex and Assumptions (VI) be satisfied. Let 
(x*,p*) be a local minimal solution of (GP), Also let Assump 
tions (V2) and (V3) be valid. Then the algorithm converges 
locally quadratically to (x*,p*), i.e.. 


> 0 


3— (x^^^ dB A 


' 3 6 > 0, 

||x^^^ - X* I I ^ 6 V- id N, I I k C., 1 Ix^^^-x^^l I 

where { (x^ is a sequence obtained through 
Algorithm (A1 ) with (x^'^^p^^^) as its initial member. Here, H 


is the set of natural numbers . 


Proof : 

Choose 6 with 0 < 6^ < 6o L.* d* 6 < K. . 

O 0*2 1 2 O 1 

Let (x,p)dB with ] | x-x* || ^ ‘Sq (x,p) be minimal 



26 


solution 
j I x-x*| 

<< P(q>-] 

Consider, 

IIP (x,!" 

= ||[P(x, 

^ IIf(x* 

Consid er , 
P(q~T x) 


of li) ^ Lemma -3 

I P(q~T x) - P(q-T x'^) + 1^2 | |x 




x) - P(q-T x^) + Z2 I I X - F (x,|i)|| + 

(x, ti) 

E :2 IlF (x,iJ.) ~F (x,]!) I 1 (4.1.1.i) 

(x,p) (x*,^i*) 


^(x,ii) (x-x) - F(x*, 4 *) 9_F(x*, li*) (II-p*) 

^ 3x " 3li 

„ lP(x*,P*)(i-x*) I) 

3x 

n) + ii!(x,p)(l*“4) ^ 3_F(x,|0 (x;'*'-x) - P(x*,ti'^)] 

^ ^ ^ \i 3 X 

3P(x,|i) X* 3P(x*,ii*) X* 

” 3x ■^3“? 

. /iP(x,p) iF( x"*^ , li* ) >, -|, 

+ ^3x ~ 3x 

(x,|i) 

(x - X* ) I 1 (4 . 1 . 1 . ii ) 


- P(q-T X*) + K 2 I I X - F (x,ii) I I 

(x,li) 


By Corollary-1 (iii.b) 
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P(q-T x) + K 2 I I x-F (x,[i)|| 4 P(q~T x*) + Z. ! 1 x*-F (x*,q*) (( 

=>P(q-T i) - P(q-T x*) + Z 2 I I x-F ff 

(x, q) 

^ K 2 ||x’"-F (x*,^x*) II (4.1.1.iii) 

(xwO 

Substituting in {4.1.1.i) from (4.1.1.ii) and (4.1.1.iii) 
lli-x* II ^ 2Z2 MF(x*,ti*)-F (x'',|i*)|| + 

(xj^x) 

E II f^l(x,^x) „ ii:(x*,ix*))(i-x*) I I 
2 ' ' '3x 9 X 

^ Z2 I I x-x*| I ^ 4 - Z2 I I x-x* II II x-x* I I 
^ Z 2 II x-x*|l2 + K 2 6 ^|| i-x* II 

K L 

•■=> I I I-x* I I < J I I x-x*|| 2 =0, I I x-x* I 

Z,-L.Z, 6 ^ ^ 

1 1 2 o 

So the assertion follows for every 6 with o < 6 ^ *^0 

G^6 < 1. 

RE MASK 

In the above convergence proof the function f(t,tx) is ■ 
assumed to be continuous in t and linear in p. The linearity in 
\i is not necessary if the function ?(t,ix) is differentiable in t. 
In such a case the problem can be handled by modifying 
g(t,s,x(s)p) to g(t,s,x(s),|3,[x) (:= ^ ' ^^^+g( t , s,,x( s ) , P) ) 

and f(t,p) to f(p) (: = fCo^p). V/ith this the problem is 
solvable with the above algorithm provided the modified problem 
satisfies the required conditions. 
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4.2 EITE'TSION OP COWERGEi\rCE OP ALGORITHM (11) : 

In the previous section the function f(t,p) was restricted 
to be linear in The uniqueness in the local minimal solu- 
tion of (GP) was assumed with respect to the space C^[o,l]. In 
this section the case where f(t,p) is nonlinear in \i has been 
studied. Por the convergence proof of Algorithm (A1 ) the uni- 
queness of the solution is assumed in the set B(: = C^[0,l] x A). 
In this case the theorem possesses a local character with res- 
pect to \i as well. 

Por this purpose the essential assumptions and auxilary 
results are given below ; 

Assumption ( V2 . m ) t 

(x*,p*) is a strongly unique local minimal solution of 
(GP) if the following holds : 

X* = P(x'^,p*) and 3 ^ 

> 0 3-(x, p) B A ( I |x-x* I I + I I P-P* 

Ax = P(x, p.) => 

P(q“T x) - P(q-T x*) ^ ( | | x-x* jf+ || p-p* | |) 

Lemma-5 : 

Assumption (V2.m) => 

{“V-(x,p)c:b a (llx-x* II+ M p-p*II) ^ 6^/2 => 

P(q-T x) - P(q-T x*) + ^2 f I x-P(x,p)([ 

K^(||x-x*|l + II p-p^M ) } 
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where 

= iC + K^) e^ 

Proof ; 

By Lemma- 1 (i) 

3 (xwO€lB with X = P(x,]I) and 

I I x-x| I e^ II x-P(x, tO I I 
In case ( | | x-z* [ | + | I I ) ^ 

by Assumption (VP.m) 

(I I x-x* I I + II p-p* II) ^ ( I |z-x I l + l I x-x*| I + II fl-p*! I + I |p-pl I ) 

e^ I |x-P(x, p) I I 4- P(q-T x) - P(q-T x*) 

(by const?miction in lemma-l(i), p = p) 

I Ix“P(x, p) I I + oil x-x I I + P(q-T x) - P(q-T x*) 

<K 2 1 I x-P(x,p) I I + P(q-T x) - P(q-T x*) 

Now consider the case (| ( x-x* | | + | | P”P* | |) > <5^ 

K^(||x-x* lU II p-p* ||)<K^(||x-x* 11+ II p-p*|| - 

I I X-X*| I - I I P-P*| I ) 

.< ( I I x-x I I +11 p-p| I ) 

= I I x-x I I , since p = p 

= j I x-x I I + P(q-T X*) - P(q-T x*) 

$ I I x-x I [ + P(q-T x) + G I I x-x* | j - P(q-T x*) 

^ I |i-x H + C I (i-x( I + P(q-T x) - P(q-T x*) 
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^ (K^+C) I lx-P(x, [i) I I + P(q-T x) - P(q~T x*) 

= Kg ||x-P(x,ii) 1 ! + P(q-.r x) - P(q-T x*) 

Lemma ~6 : 

Assumption (V2.m) and convexity of B => V(x,p)CB 
P(q-T x) - P(q~T x^) + Kg | | x-P (x,p) | | ( | U-x* \ \+ \ \ j ) 

Proof : 


Define x^^ % = Xx + (l-X)x* = x* + X (x-x*) and 

Px = P* + ^(P-P*) 

For sufficiently small X . > 0, Lemma~5 and convexity of 
B => 

P(q-T XX ) ^ P(q”T x*) + Kg | ! x^^ - F(x^ , Px) I I ^ 

11+ ih^x ~ 


:>XP(q~T x) - XP(q~T x+) + Kg((Xx-- XF(x*,p*) + F(x*,p*) 

- F{x^ , Px) I 1 X ( [ jx-x* 11+ I j p-p+i I ) 

^ F(xx,Px) - F(x+,p*) 

=>P(q-T x) ~ P(q-T x ) + Kg j (x-F(x*, IJ.*) - 

>K^ ( I Ix-x* I I + I I p-p*| 


^ P(q-T x) - P(q~T x*) + Kg 1 j x-F ■ (x,p)| 1>K (| | x-x+j | + 1 | p~p+ | |) 


3- S X 0 • 
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Assumption (Y3.m) ; 

(a) is local lipsciiitz continuous in a neighbourhood, of 
h* ; i . e . , 

62 ' >0, ^ I'’"'] > ^•’'2 — 

I I I I ^ ^2 ' ^ II II < ^2 ' 

9f(t,pJ 3f(t,Pp). 

11-- 5ir II < h II “r'“2 II 

(b) Same as (73. b) 
lemma -7 : 

Prom (■ 73 . m) and convexity of B it follows that, 

(x,1I) c. B, (x, p) c: B, I I x-x'^ 1 j << 62 , I I ll-'li* j I ^ 2 ', 

I I I i < 62 ’ M (I < ^2 ’ ==> 

I Ip (x, p) - p(x, h) I f ^ i 1 (i 1 x-x|| ^ + 11 1 p ) 

(x, ii) 

where 

L = Max. (L^ ' , ) 

Proof : 

Define x = x + X 4 (x-x) and 

A 'j I 

|i ^ = [I + ^2 ( 

^ 1 

II P (x,|i) P(x,ii)||.^ =11 / HP'hi) d>2 ” 

(x,II) . 0 ^ 

_ _ 1 

f'(p)(p-p) + J )(x-x) dx^ --G'(x) (x-x) 

0 ^ 
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Here 

^ represents j and 

G'(x^ ) (x-x)(t) represents J ^®^^(x-x)g ds 

o 

1 

l|F __(x,p) - P(x,^)||^ ^ I Ijf'CpXg) -• f ’(^)| It ^^2 '• 

(x,p) 0 

+ j 1 I G ' ( x^ ) - G ' ( X ) I I ^ d^ ^ . 1 1 X"X 1 I 

0 

1 _ o 1 o 

I ^2 ^ ^ ^ x-x I I 

0 0 

-5 T I I X-xl I ^ i ' II \l-~l I I ^ 

=> I } P _ (x, p) - P(x, p)| I $ ^ L (II x-x II + n p-pl I ) 

(x, p) 

4.2.1 SECOND COWERGENCE PROOP POR ALGORITHM (A1 ) ; 

Theorem~2 : 

Let A be convex and Assumption (VI) be satisfied. Let (x*,p*) 
be a local minimal solution of (GP) and assumptions (V2.m) and 
(V3.m) are valid. Then the algorithm (A1) converges locally 
quadratically to (x*,p*), i.e., 

3 6 > 0, C, > 0 A (||x^^*-z*|| + 

+ II < 6 

=> II+ II pi-+')-,i»||) < cplU^^Vx*!! 

+ lln'^> - i*1lh 


2 
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V' 


i d. N, where 


iCN 

(11 ) with ^ 


is the sequence obtained through Algorithm 
as starting point; H is the set of 


natural numbers. 


Proof : 

Choose 6^ with 0 < 6^ < minCd^'^d^) and 1 ^2 '^o * 

Let (x, p) d B with ( | j x-x* 1 1 + M 1 ) -^ and (x, p) the 

minimal solution of (LP/ \). 

P/ 

Prom Lemma -6 , 

K^(lli~x*|l + ||p>p*ll ) ^ P(q-T i) - P(q-T x* ) 

+ ^’2 I I ^ ~ 1 I 

(x*,p*) 


4 P(q-T x) - P(q-T x*) + Kp! 1 x-P (x, p) !| 

(x, p) 

+ KpIfP (x.p) - P (x,p) II (4.2.1.i) 

(x,p) (x*,p*) 


Consider, 

(P (x,p) - P (x,p)) = P(x,p) + P'(x,p) ((x,p) -■ (x,p)) 
(x,p) (x*,p^) 

- P(x*,p*) - P-(x*,p*) ((i,p) - (x*,p*)) 

= P(x,p) + F' (x, p) ( (x*, p*) - (x,p)) - P(x*,p*) 

- F' (x, p) (x*, p*) + F'(x,p) (x,p) 

+ P'(x*,p*) ((x*,p*) - (x,p)) 
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= - (P(x*;-p*) - p - (F'(x,ji) - F'(x^,ii*)). 

(x, \i) 

- (x,!!)) 

— > !If (xji) P ^ ||p(x*,ii*) -F (x-",ii*)l| 

(x,ii) (x*,ti*) (x,ti) 

+ ||(P’(x,[i) -F’(x*,ti*)) ((x^',^*) - (x,^))!! (4.2.1.ii) 

By Corollary~1 (iii.b) 

P(q-T x) + K 2 I |x-F (x, 11)1 I inf. { PCq~T y) 

(x,ii) 

+ ^2 I I y-F (x,Ti) II : (x,^) CB} 

< P(q-T X*) + K 2 II X* - F II (4.2.1.iii) 

(x, \i) 

Substituting in (4.2.1.i) from (4.2.1.ii) and (4.2.1.iii), 

K.(||x-x*|| + ||II-ti*||) ^ PKpll F(x*,i#) -F (x*,ii*)|! 

(x,tx) 

+ K 2 l|(F'(x,|i) -F'(x*,ix*)) ((x*,tx*) - (I,II))1| 

« Kj S ( I |x-x*l |2 + I I |2) + Kj I, I I x-x*| I I |i-x*l I 

+ K 2 ' M \x~\i* I I 1 \Ji-ii* I I 

>< K 2 L (I I x~x*| I ^ + II 1^) + Pig ^ 1! + II Ii-^*l I ) 

I I x-x^l 1 + I I ]I-(i*| I ^ - (II x~x1 I 2 + I I I 2) 

Kf Kg L 6^ 

= (It x-x*l 1^+11 ^-^.*1 I 
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Thus the assertion follows for every 6 , with 0 < 6 < 6 ^ 
and 0^6 < 1 . u 

5. PORMUMTIOI'I OP THE SECOFI) ALGORITHM AFP CONVERGENCE PROOF 

This section presents an algorithm with X -strategy; that 
converges with essentially weaker assumptions. 

For this purpose the necessary assumptions and definitions 
are given below : 

Assumption f .vH : Same as Assumption (V 1 ) 

Assumption fV?) ; kcr+ with E > e^C 
0 < (3 < 1 


^ ’ X. - 1 , a: = inf. 

' jCM 

him , 

3 b = ° 

The set A is convex and compact. 

Pef inition -1 : 



0 


iff (x, p) 


(x,(j,)CI B is called a stationary point of (GP) 
is a minimal solution of (IP/-' 


Definition -2 : 


The penalty function 9 : B R is defined as, 
9(x,p): = P(q-T x) + Z ||x-F(x,p) f| 
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lemma -8 : 


Let (z,ii) C B and (x,^i) be the solution of (x) ^ 

P(q-T i) = P(q-T x) + K \ \ I - ¥ (IJi) | ( 

(x, \i) 

^ P(q-T x) + K ( j x-P(x,ti) ] I = 9 (x,ii) 


Proof ; 

¥e prove by contradiction. Suppose the assertion is not 
true. Then, 

P(q-T x) > P(q~T x) + K || x--P(x,(i)j| 

> P(q-T x) - C I I x-x I j + K 11 x-P(x,p) | | 

> P(q-T x) - G e^ | 1 x-F (x,p)|| + K j| x-F(x,p)j| 

(x,p) 

(taking (x,p) 3~ ( | x-x || ^ I 1 x-F (x,ii)||) 

(x, \i) 

> P(q--T x) + (Z - C e^) I I x- F (x,p) || 

(x,p) 

=> P(q-T x) > P(q-T x)A x = F (x,p) 

(x, \i) 

^=>P(q-T x) is not a minimal solution of (ZP^^ 

■=> P(q-T x) ^ 9 (x,|i) u- 

Oorollary-2 : 

In case min P(q-T x) over all (x,p) d B such that 

X = F(x,p) is unique and min- P(q-T x) over all (x,p)£;;; B with 

X = F (x,p) is unique, then both the minima must coincide. 
(x,p) 
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5.1 ALGORITHM (A2) ; [iteration method with x -strategy] 
Start : Choose C^[o,l], 

I I x'^^ ^ I I <c M > 0. 

Iteration Step : 

Suppose is already constructed. Determine 

(x^^\ as the minimal solution of the linearized approxi 

mation problem (iP^^(i) ^^(i)^). 

In case P(q-"T x^^^) = 9 (x^^\ P^^^) is a 

stationary point of (GP) and the iteration will be stopped. 
Otherwise , 

P^^^) > P(q-T x*"^^) 

Take ; 

/ . \ 

Determine the smallest index j; = N with 

- P A ((p(x^^\ p^^^) - P(q-T x^^b) 

J 

Set, 

»i 

«j 
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A few further assumptions and definitions, essential for 
the convergence proof are given below ; 

Assumption (V 5 ) : f is linear in p. 

Definition -3 ; 

The linearized penalty, function, B R, (x,p) d B 

is defined as ; 

9 ^(x,p) : = P(q-T x) + K 1 I x - F (x,p) 1 | 

(x,II) (x,p) 

lemma -9 : 

let (x,[i) d. B • (x,p) d] B be the solution of (UP ) 
with 9(x,ii) > P(q-T x) . 

Then 3 6 > o 3 — o < X < 6, 

9(x+ X(x-x), p+ X(p-p) ^ 9(x,p) - M (9(x,p) - P(q-T x) ) 

Proof : 

9 possesses in (x,p) d B a right derivative 9*(x,p) and 
the following holds ; 

9'(x,p) ((x,!!) - (x,p))=9' (x,p) ((x,p) - (x,p)) 

(x, p) 

I 

/ __ I 

^ 9' (x,p) - 9(x,p) = P(q-T x) - 9(x,p) < 0 . j 

(x,p) 

From here the assertion follows as 0 < P 1 . 
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Remark : 

From Lemma-~9 one concludes : is a local minimal 

solution of (GP) 

==■> is a stationary point of (GP) 

=r> X*=P(X^-,P*) 

5.1.1 C0N7ERGBUCE PROOP FOR AIGORITHM (A2) ; 

Theorem-? ; 

let A he convex, compact and Assumptions (VI), (V2) and 

(V?) be satisfied. Starting with an arbitrary (x^ ^ ^ ^ ^ ) ^ B 

( i I ^ ^ 11^ M ^ 0) the iteration method (A2) is carried out. 

In case the method terminates at the i^^ iteration step 

p*'^^) must be a stationary point of (GP). Otherwise the 

method provides a bounded sequence { (x*'^^, p^^^) } in B, 

iCH 

which possesses a. limit point. 

Every limit point is a stationary point of (GP). 

Proof : 

(i) The sequence possesses a limit point in B : 

By construction { 9 (x^^\ p^^^)} monotone 

decreasing sequence and therefore for some constant C > 0 

ViC N } 

I I x^^^ - P(x^^^ , p^^^) 11^5 

It follows from here, V iC E, V" t C [0,l] ; 
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I 1^5 +1 (t)l 

^ C + 1 |P(o,ii^^^) 1 I + j E;(t,s) !x^^^(s)l ds 

O 

By Gronwall’s Lemma one obtains a bound for and hence an 

uniform bound from boundedness of A. 

Obviously {x^^^ ^iCN uniformly bounded and equi- 
continuous. Bo by Ascoli's theorem, {(x^^^, 

^ i€ K 

possesses a limit point in B, as A is compact and f is continuous 

(ii) Every limit point of in B is a 

stationary point of (GP) ; 

Let (x*,p*)C' B be a limit point of {(x^^\ > 

¥e prove by contradiction. 

Let (x*,p*) be a non-s tat ionary point. Then, 

9(x*,p*) > m; = inf. { P.(q~T x) : (x,p) C B, 

X = P (x, p) } 

(x*,p*) 

Since 9 is continuous and {9(x^^\ ^ mono- 

tone decreasing sequence, the following holds; 

9(x*,p*) = inf. {9(x^^\ p^^^) ; iC N } 

Wow we shall show that J iCW 3 ™ 

9(x^^^''^, < 9(x*r (5.1.1.i) 

Let T) : = 9(x*,p*) - m > o and (x, p) C B with 


9 (x, p) = m. 

(x^,p3 
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Let be a minimal solution of (LP /.^ 

u<-^K iS^h 

C onsequently , 

Choosing (x^^\ sufficiently close to (x*,ii*) ; 

I 9 (x. II)»9 I ^ K II p (ij) .. F (^,11)11 


). 


-f ^ 




K I |p(x^^\ -p (x^^\ 1 +k1|I 

(x^,-) o 

ig.('t,s,x*(s)))(x-x^^^) ds|| 
9x s 1 I 


^ p/2 


From the above estimates, 

- P(q..T :>, (p(x*,ti*) 

~(9 (x, 11) + ti/2) ^ r ]/2 

(x*,tx^) 

Let R > 0 be 3- V ^ RA 

We have V" (x,ix) C B 3 63"- o < 6 < 4R 


A 1 |x-x* 1 I 6 

l|p(x,ii) - P (x,ix) II ;< ^ - - ^ ■ 1 - ^ ' ^ ' ||x-x*|| 

(x3ix*) 

Row we give an estimate for X. (j = below ; 

c 

Por 0 < X < ~ ^ 1 because of, 


< R. 
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- X* |U< II - x*ll +X ||h(x)|k| + %|E 

2 4R 

the following holds ; 

+ Xh''^^ + Xl^^)) ^ cp (x^^K ^1^^^) 

Cx*,ix^) 

+ h ||p(x^^^ + Xh*^^^, + Xi^i)) 

- F + X h^^\ 

cp (x^^K xi^^^) + (M + 2RX ) 

(x^, 11*) 

(taking ||x^^^ ~ x* | | ^ ^) 


^ cp _(x^^^+_ Xh^^^,li^^^+ X 1^^^) + (|^ + X ) 




.<(1-X)9 (i+ X) 


•$ 9 (x*" 11 ^ ) - ^P( 9 (x*'^\ 11 ^^^ ) - P(q~T x^^^)) 

. IJ.r.§J,IL ( 2 A . X) - ^-.l"£i, n .. A -. 

^ 4 MR '' 2 


<$ 9 (x^^\li^^^) - X p( 9 (x^^\li^^^ ) - P(q-"T x^^^)) 


, , ( 1 xl^ .).a /oS „ X ) 

+ 4 ^4R ^ > 


i*e. 


9(x^^V Xh^^\li^^^+ Xl^^^) ;< 9(x^^^ 


(i) ,,(i) 


- xp(9(x'^^li^^b "P(q-Tx^^O) 


“(i) 

■V ' * 
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In case 


a6 

4R 


>< X < 


L. 

4R 


dince 


, inf { — iil : 3 C F > = a 


> 0 , 




a6 


there is a 3 ' €I F with ~ < X.' 

4R w 3 


4R 


By the definition of 3 ^^^ in the Algorithm (A2) it follows. 


D = D 


i ^ ^ ^ .< i ' 


and 




ad 

4R 


The inequality (5.1.1.i) is obtainable as, 




,(i) ,,(i) 


+ X h^^^ 1^"^^) 

J J 


9 (x^ ) - X - P(q-T x*-^^)) 

J 

^ V(x*,n*) + fi^ - f| • P ? < f (=^*.1“*) 


REflARK 


In the above convergence proof f is assumed to be linear 
in \i. The proof can be extended to the case where f is not 
necessarily linear in p but is differentiable with respect to p, 

Bor the convergence proof in this general case it is only 
required to replace 1 | x| | by ( | |x | j + I 1 P 1 I ) 1 I ^ 

by ( 1 U^-X 2 M + 11 4^-1^2 11 ^ above proof. 

6 . METHODS OP SOIVIFG THE IIBPAR PROBIEM 


The linearized problem arising in the iteration schemes 
above is as follows : 


minimize P(q-T x) 

(x,p) C B A X = P (x,p) 

(x, p) 
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where , 


x(t) = F (x,[i)(t) = f(t,7i) + 

{x,\i) 

+ / g(t,s,x(s)) ds + / ds 


o 


B - C^[0,lJ X A, A C , A is a convex subset. 

For simplicity of notation we write (6.i) as, 

t 

x(t) = F (x,[i)(t) = a(t) + F(t)[X + j K(tfS) x(s) ds (6.ii) 

(x,To ° 

We consider below the solution methods for few special 
cases of this problem : 

6.1 PROBLEM WITH LHOWN RESOIVEHT KERNEL t 

If the resolvent Kernel for the system equation (6.ii) is 

known apriori, x can be explicitely expressed as a function of 

[X. Let R be the resolvent Kernel. Then, 

t 

x(t) = a(t) + D(t) [x + J R(t,s) (a(s) + D(s)|i) ds 

o 

= b(t) + H(t) p, where b and H are known functions, 

b : [ 0, 1 j -► R^, H : [ 0, 1 ] R^ x R^ 

The problem reduces to. 


Minimize p(q,-P(B + H p) ) 

R C A 
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This problem can be solved using a suitable technique 
depending on the seminorm P. 

6.2 PROBLEM WITH DEGENERATE KERlsTEL 

In this case the problem is easily reduced to one with 
linear differential equation constraints «nd thus can be solved 
using standard techniques. 

To do this let us consider the system equation (6.ii). 
x(t) can be written as ; 

M 

x(t) = a(t) + D(t)ii+ I Gj^(t) Yjjj(t) (6.2.i) 

m=1 

where, 

K(t,s) = I G^(t) H^(s) (6.2.ii) 

m=1 

t 

I^(t) = J H^(s) x(s) ds (6.2.iii) 

o 

Now differentiating (6.2.iii) and substituting from (6.2.i) 
we obtain, 

M 

+ H^^(t) ( I G^(t) • Y.(t)) (6.2.iv) 

i=1 

V/iijh. tiiis “tiic ppoblsm of miniiiiiza'tioii burns oub bo bo oquivalenb 

M 

P(q-T(a(t) + D(t)n. + J Im(‘t,p))) 

m=1 


Minimize 

pCA 



46 


subject to 


M 


Y.(t,- \i) = H (t) [a(t) + D(t)[i + I & (t) Y^(t,Mi)] 


in=1 


m' 


6.3 PROBLEM ¥ITF INTEGRAL COST FUNCTIONAL 


¥e 

problem 

Problem 


give a set of sufficiency conditions for the following 

1 

iPl • Minimize J : = / f^(s(x),s) ds (6.3.i) 

0 


subject to the constraints, 

t 

x(t) = f(t,p) + J i{:(t,s) x(s) ds (6,3.ii) 

0 

where f and f^ are convex and differentiable with respect to 
p and X respectively. 


Theorem--4 : 

The pair (x'^,p*) is a solution of the optimization problem 
(P) if it satisfies the following conditions: 

(i) 3 a row vector : [0 ,i] R^ 3— 

1 

if;(t) = f (x*(t), t) + I ^Hs) K(s,t) ds, tC[0,l] 

°x +. 

1 ^ 

and J ii»(t) dt = 0 

0 

(ii) X* is a solution of the constraint equation (6.3.ii) 

corresponding to the parameter value p*, i.e., 

t 

x*(t ) = f (t , p*) + / K:(t ,s) x*(s) ds, t [0, 1 ] 

o 
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Proof : 


Por any satisfying equation (6.3.ii) and as 

above , we have , 

1 

AJ = J(x,[i) - J(x*,[j.*) = / [f^(x(s),s) - fQ(x*(s),s)J ds 

0 

1 

^ J ^o (s)>s) (x*(s) ~ x(s)) ds (by convexity assumption) 
0 ^ 

1 1 

- f [ ^(u) x*(u) - J i|;(s) K(s, u) ds x*(u) - 'Pin) x(u) 

0 u 

1 

+ I" jjjis) K(s,n) ds x(u)J du 
u 

1 1 

/ 'p(u) [f(u,p*) - f(u,p)] du ^ / ij(n) f (u,|i*)((i*-p) du 


(by convexity) 


J ,ij(u) f (u,ix*) du(p*-p) = 0 


> (x*, ti*) is an optimal pair. 


7 . CONCLUSION 

In this chapter we have given convergence proofs ’ of two 
algorithms for the numerical determination of parameters in a 
system of VTIE to m.inimize a given seminorm. Each iteration 
of the algorithm without X -strategy requires much less compu- 
tational efforts as compared to that with X -strategy and is 
quadratic convergent. But the former imposes stronger conditions 
on the functions f and g for its convergence and the convergence 
is local. 
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No doubt a large class of physical systems can be repre- 
sented by VTIE but it does not cover all. One must investigate 
the convergence of these algorithms for systems described by 
Fredholm Integral Equations. An obvious extension, if possible, 
could be to consider systems with n(n > 1 ) - independent 

variables . 

The problem as formulated in this work deals with deter- 
ministic systems. A large class of systems in practice being 
stochastic, an attempt to formulate the problem in a stochastic 
setting will be useful. 

The applicab-i lity of these algorithms for sequential 
estimation problems (with appropriate modifications if necessary) 
could be studied, so that these may be used for on-line parameter 
estimation problems. 

«/ 



CHAPTER II 


OPTIMI REDUCTION OE DYNAMICAI SYSTEMS 
1 . INTRODUCTION 

The general problem of model reduction is to choose a 
system model from a given class that approximates, in some 
sense, the input-output characteristics of a given system. In 
the literature several methods are available to reduce the 
order of a linear time invariant system. These methods can be 
broadly classified as eigen value retention techniques [22,251 
and non-eigenvalue retention techniques [23,24]. 

Most of the eigenvalue retention techniques are based on 
the retention of the dominant eigenvalues of the original 
system in the reduced model although there are exceptions to 
this. In Elarshal's [25] method the group of eigenvalues to be 
retained is chosen by minimizing an integral square error cri- 
terion. 

Anderson [23] and Wilson [24] have proposed methods where 
uhe original system eigenvalues need not be retained. Anderson 
method is based on the evaluation of the projection of a speci- 
fied vector on to a linear subspace. It fits the output data 
from the original system to a simplified model by the least 

square method. 

Wilson gives equations for the determination of the 
optimal reduced model of a MI7S by minimising a functional on 
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the error between the output vector of the reduced model and 
the original model. The equations proposed are a set of non- 
linear matrix equations which do not possess a unique solution. 

For the solution of this set of equations and determination of 
an optimal reduced model, numerical algorithms incorporating 
standard minimization routines, vjhich require the structure of 
the reduced system matrix to be constrained in some manner, 
have been proposed by many authors. The algorithm proposed by 
Mishra and Wilson [26] is self-contained and eliminates the 
constraints in the reduced model structure. But convergence is 
not guaranteed for any general LTIVS. Moreover the conditions 
for convergence of the algorithm for MIMO systems with arbitrary 
eigenvalues in the reduced model is not ascertained. 

Anderson's method can be applied to time-varying systems 
provided that time variations are not rapid. In case of non- 
linear systems a linear reduced system could be obtained giving 
a least mean square fit over the range of operation of the non- 
linear plant. Very little is available in the literature for 
reducing a general dynamical system to other than a LTIV system 
structure. We have delt with a model reduction problem where 
the reduced model is a Volterra type integral equation. The 
algorithms developed in Chapter 1 are utilized. As the algorithms 
require the input-output functions, the importance of the stru- 
cture of the original system is minimal except for the computa- 
tion of the output function. Of course in certain cases the 



51 


original system equations can be used to get a better matching 
in some sense and reduction of computational effort as discu” 
ssed in the case of ITIVS considered in Section 4-. 

2* REDUCTION OP A GEl'JERAl SYSTEM 

Let S be a given general system. We intend to obtain a 
reduced model S' of a given structure so that we obtain the 
best match between the outputs y and y' of the two systems 
corresponding to a given input u(t), t^ [t^,t^]. Mathema- 
tically ; 

Let y(t), tC[t^^,t^] be the output of the original 
system, corresponding to a given input u(t), tc-Et^jt^]. Let 
the reduced model be, 

t 

S': x(t) = f(t,p) + J g(t,s,x(s), u(s), P) ds 

^o 

y ' (t) = C x(t) 

where, f and g are known functions of their arguments and C is 
a constant matrix. .The problem is to determine the parameters 
(p,fD) so that certain seminorm P(y-y') defined over the pres- 
cribed interval [t^,t^] is minimum. 

The problem statement is exactly in the form of the problem 
considered in Chapter 1 ,* where the original system output is a 
known function of t, once the response of the original system is 
computed for the given input function. The algorithms of 
Chapter 1 can be directly'^^l^ppi^^lPiq^M^f functions 

/ / 7 K nn 

. 8 . 211 .?. 
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describing the reduced system satisfy the required smoothness 
conditions . 

3- REDUCTION OE LTIYS ; 

Let 

Ss z=Az+Bu , z^R^, u ^7 R^ , y ^ R^ 

y=Cz z(o)=z,p<n 

be a given system. 

Our interest is to construct a reduced order model S-n for 

ri 

3 such that the integral square error (ISE) between the outputs 
of the original and reduced system is minimum. Let, 

Sj^: z=Az+Bu , zCR“, uCR^, y £1 R^ 

y = 0 z m < n 

The problem is to find the system matrices (A,B,C) and the 

initial condition vector z(o) = z such that, 

o 

00 ^ 

J ; = J (y-y) ' (y-y) dt, is a minimum, 
o 

For the algorithms described in Chapter 1 to be applicable, 
one requires the interva.l of integration to be finite and the 
reduced system output matrix to be known apriori. Depending on 
the system requirements C matrix can be chosen conveniently. 

The minimization of J can be achieved for all practical purposes 
taking a sufficiently la.rge interval [0,T] instead of .(o, « ) . 

The choice of T is quite subjective. It should be chosen large 
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enough to accomodate the prominent system properties such as 
system stability, system frequencies of oscillations, nature 
of the input function etc.. The implementation of the algorithms 
may not be of much use for problems so stated with arbitrary 
measurable essentially bounded forcing functions because of 
large computational time requirement; as in such a case one will 
have to take a very large value of T to obtain a satisfactory 
model. Of course one can conveniently handle problems with 
smooth forcing functions; e.g., periodic functions, exponential 
functions or polynomial functions etc.. 

In the next section we will give a modified statement of 
the problem for stable ITIVS. This class of systems is most 
frequently encountered in practice. ¥e will discuss the various 
aspects of the reduction problem in detail, in this case. 

4. REDUCTION OF STABLE - LTIVS 


let , 

3 : z=Az+Bu 
y = C z 


zCR^, u€R^, y^R^ 
z(o) = Zq, n >p 


(4.i) 


be a given stable linear time-invariant system. ¥e are 
interested in constructing a reduced order stable model ; 


"R 


/V A A 

A X + B u 


j. A A 

y = C X 


xCR 

m < 




u€I R^ , 




n 


(4. ii) 


such that the following performance criteria are satisfied *. 
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(i) steady state the output of the reduced model and the 

original system ma,tch exactly for any mea.surable essentially 
bounded forcing function; i.e., *' 

Lim [y(t) - y(t)] = 0 


(ii) For the transient performance we minimize the sum of the 
ISE in the initial condition response and an upper bound on the 
ratio of the ISE due to forcing function and the integral of 
the L2-'-norm of the forcing function. (This choice of the 
transient performance gives a good approximation for any square 
integrable input function), i.e., 


j = j + j ' 

0 

where 

Jo = / < (C e^^ ~ C e'^'*^ x^), (0 z^ - C e^"^ x^) > dt 


J ' ; = some upper bound on 1 1 y~y 11 / f I hi 1 1 dt , /II u II dt o 

6 0 

I 1 • I I represents l 2 -norm. 

We can take for J, 
r 

J = J + I J. 

o i 

i=1 

^ ^ ^ ^ 

J.= / < (C e^"^ B - C e^"^ B)e. , (C e^"^ B - C e^"^ B)e. > dt 

0 

where, e^^ represents the i"^^ 


natural basis vector. 
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Ji represents tne ISE due to unit impulse input function 
i-e. , u(t) = 6^(o) 

For S and we have , 

_ t _ 

y(t) = G e z(o) + I C B u(s) ds 

o 


y 


(t) = C e'^'*^ x(o) + / C B u(s) ds 


In order that the steady state matching criterion is 
satisfied, we must have, 


Lim [C e^”*" z(o) - G x(o) + | [g 


At 


i - C 


B]u(s)ds] 


= 0 . 


and this is ensured for all admissible u if, 
t __ 

Mm ! [a - C B] ds = [o] 

4 - 0 

^ “^OO 

Or equivalently, 

C A~'' B = C A"’^ ' B = D (4.iii) o 

A 

(4.iii) is a set of non-linear equations in the elements of A and 
%; C being a previously selected matrix. 

Let B be the general solution of the equation; 

t![x] = D (4.iv) 

Ai 

Comparing (4.iii) and (4.iv) we can assume B of the form; 

B = A B - (4.v) 
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The elements of B are functions of n^.r independent parameters. 
Here n^ is the dimension of the null space of C. 

With this we have the reduced system as, 

:x = A(x+Bu) 

y = C X (4. Vi) 

To meet the transient specification we will use the algori- 
thms discussed in Chapter 1 . 

Por this purpose we augment the system equations (4.vi) by 
considering the parameters to be determined, as state variables.^ 

A 

Let, x(i), x(i) denote the ith component of the vectors 

A 

x^ X respectively. Define, 

x(i);=x(i) ,* i = 1,...,m 

A \ . 

X ( i . m+ 3 ) : = j ,• i = 1 , . . . , m ; j = 1 , . . . , m 

and the n^.r independent parameters in B be denoted by, ^ 

2 

x(m +m+i) , i = 1, ..., ;> 

’i 

Then the elements of B, are obtained as 

B. . = h. .(x) ; i = 1, ..., m; j = 1, ..., r 
iJ 13 / 2 N 

(m +m+nQ.r} 

where, h. - are functions of xCR determined by 

the equations (4.iv). 

With this the modified system is obtained as, 
i X = P(x,u) 

y = C X , C = [C : O] 
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where , 


m 


P^(x,u): = I z(im+j) [x(j) + I h^^(x) • u^] , 


j=1 


k=1 




1 


J’j^(x,u): — 0 ; i - m+1, (m^+m+r) .r) 


( 4 .vii) 


The linearized system can be obtained by simple manipula- 
tions as 


X = p- (x ) = i(x) X + b(x) 


( 4 .viii) 


y = C X 


where 


b.(x) 


{ i + 1 ) m 


(m 4-m+nQ.r) 


bi(x) 


bj^( x) 


I x(k-im) x(k) - I 
k=im +1 k=(m^+m+l) 

[ I x(im+j)( I u. )J x(k) ; 

j =1 1=1 "^k 1 


m 1 f % m t f m 

if n^.r ^ 1 

(i +1 )m 

I x(k-im) x(k), i = 1 , . . . , m ; 


( 4 .ix) 


> 


k=im +1 

0 m < i .< 


if n^.r = 0 
0 


( m^+m+n^ . r ) 


^^(x) = x(inH- 3 ) , j = W — f i = 1, m 

(J 

A^.^(x) = x(j-im) + Z kj_^(x) u-, ; im < j ^ (m +m+n^.r) (4.x) 


13 


1=1 


A^^(x) = 0 for all other elements of A. 
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The linearized problem now is to minimize J subject to the 
constraint equation (4.viii). 

Consider the functional, 

T 

I' = J (y~C x)' (y-C x) dt (4.xi) 

0 

where x is a solution of (4.iii) 

let ^ = A(x)f , “^(o) = I, the identity matrix. 

Then, 

* f 

x(t) - ^ ^ (s) b(x(s)) ds 

0 

= $(t)xQ + Y(t) (4.xii) 

where, Y('fc) is a solution of (4.viii) with x(o) = 0. 

Substituting for (4.ii) in (4.xi) one obtains the equiva- 
lent problem of minimizing I’ as follows ,* 

Pind a set of initial conditions x^* for (4.viii) such that, 

I = x„ ' D x^ - 2 x^ ' E is a minimum. 

0 0 0 

where , 

T T 

D = I ^(t)' C C $(t) dt ; E = J $(t)- C'[y(t) - CY(t)] dt 
0 0 

(4.xiii) 

Consider the minimization of ; 

We have y^ = C z°, z° a solution of S with z(o) = z^ and 
u = 0. The modified system M^(; x = P°(x,u)) and the linearized 
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system Ijq( : x = A (x°) x + b°(x°)) for this problem are obtained 
by substituting u = o respectively in M and 1 derived above. 

The corresponding is obtained by substituting for and y 
in (4.xiii) respectively and y^ as obtained from and for 
y we substitute y^. This gives, = x^ ' D° x^ - 2 x^' E°. 

Consider the minimization of i = 1, r. As in the 

case of the modified systems and 1^^ are obtained by substi- 
tuting u. =0, 3=1, r , u. = 6(o) and y. obtained with 

3 i ^ 

z(o) =0, u. = 6(o), u. = 0 , 3 ' = 1, r from the respective 

_ ^ 3 i 

equations M,L and S. and y^ are accordingly obtained as the 

state transition matrix and the appropriate solution of 1^. With 

these, J. = X ' x^ - 2 x^’ E^. 

1 o 0 o 

Now summing up J^'s we obtain, 


r 

I 

1=0 


[ I D^] 


X, 


= X. 


i=0 

' D x_ - 2 X, ' E 


2 x^’ [ T E^] 
° i=0 


*0 ~ ' 0 0 
The linearized problem can be stated as; 


(LP __j ; 3 =0, r) ; minimize J 

X ( o ) €1 s 


X. ' Ex 
o 0 


2x^' E 


The iteration scheme for the present reduction problem 
is as follows : 

Start : Choose x^°^€I S 
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Iteration Step : 

o (i)/ ^ 

Suppose X (o) is already constructed. Construct x(o) 
as the minimal solution of (LP-j , j = o, , . . , r) In case 

1 lly. - = I II y. 

3=0 J 3=0 

r 

+ K ( I I I x^ ^ ^ - F^(x^^^^)|]) , x^^^(o) is a solution of 

j=o 

the reduction problem and the iteration will be stopped , other- 
wise put h^^^^ = , 3 = o, ..., r. Determine the 

smallest index 1; = 1^C.!T with, 
r r 

I lly. - I I + K( I I 1 x^^^^ + h^^^^ 

2=0 "3=0 

r 

_pj(^j(i) + X hj<i))|l)^ [I lly - 0 II 

3 =0 

r r 

+ il( I ilx^^^^ - I I ] (1-PA. ) + |3X,( I lly. - C II) 

3=0 u X _j 

Set, = x^^^^ + ^2 h^^^^ , 3=0, ..., r. 

The above algorithm is for a fixed initial condition for 
the original system. This can be generalized to the case of all 
bounded initial condition vectors with a proper choice of J. 

The only change 'in the algorithm above is the index 3 ranges 
from ~(n-l) to r instead of 0 to r. 

4.1 COMPUTATIONIL ASP 3 CTS 

For the implementation of the algorithm proposed above with 
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economiza+xon of computation time and to simultaneously obtain 
a reasonable accurate result one iias to carefully choose the 
required subroutines. 

Beyond this the various other factors those can contribute 
a significant reduction of computation time are discussed below 

( of the interval length [ 0 , T ] : 

One can considerably reduce the computation time by a 
judicious choice of the interval length [o,Tj of minimization; 
which is problem dependent. A choice of T approximately equal to 
the Is.rgest time constant of the system should be satisfactory 
in most cases as all the important transient cha.racteristics of 
the system can be considered to be contained in this interval. 

It may be possible to choose a smaller interval in some cases. 
Care should be taken to retain various prominent system chara- 
cteristics. The interval should be large enough so that the 
reduced system retains stability. The choice of a proper time 
interval reduces appreciable amount of computation time maintai- 
ning a good overall matching. 

(I 3 ) Exploitation of the structure of the linearized system and 
the associated functionftl ; 

Consider the system L and the associated functional , 

The system matrix ■A(x), b(x), C and <5 can be partitioned as. 
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A(x) = 


b(i) 




[A^^(x)] [A.pCx) 


mxm 


[ 0 ] 


ki (x) 

mx1 


0 


*^11 

^ 12 

$ 

$ 

21 

22 


12 

mx(m‘^+n^r ) 

[ 0 ] 


C = [C o] 


With the above partitioning of A(x) and b(x) one is required 

to solve only m differential equations numerically to obtain 
2 

(m + m + n^r) vector functions x and Y( = (— )). For solving 
'I’ =A(x)$ , ^(o)=I one needs numerical solution of 

bi = *11 ’ *id°’ “ 


and 

^12 ^ ^12 ^ ^ 12 ^°^ 
The D and B matrices are obtained as, 


^ A A 



^1 1 

Di2 

T 

$11’ 

O' C 


<!> C ' C $ « 

^^1 1 ^ o 'i' ^2 

D; = 



= I 


A A 


^ A 


32 

hr 

0 

L*12’ 

O' C 0 ^ ^ 

«,2' O' C 


T 

$ii' 

O > 

I 

c:3> 

1 1 1 




E = 

I 

0 

3i2' 

I 

< o 

“hi 

dt = 

- ®2. 



With the system variables represented in the above parti- 
tioned form, one can obtain a considerable reduction in compu- 


tation time. 
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(c ) Specialized problems : 

1 reduction in computation time is very often possible by 
exploiting the particular problem statement, i.e., by speciali- 
zing the algorithm or a part of it for a particular problem 
one is interested to solve. ¥e discuss below some important 
cases : 

(i) Fixed initial condition for reduced model ; 

In this case one needs to compute only D22 ^ 

2 

and E respectively. This avoides the solution of the m 
differential equations ^ (x) Also the minimiza- 

tion of the linearized problem is to be carried out for the 
functional, 

2 

J = X’ D22 X - 2 E2’ X , xCSCr“ 

(ii) Reduction for a particular input function with fixed initial 
condition for the reduced model ; 

In this case a considerable amount in computation time can 
be saved for a multi-input system by taking the minimizing 
ctional as the ISE and making use of the general algorithm. 

f ^ 

(iii) Reduced system matrix with specified structure : 

If the structure of the reduced system matrix is specified, 
it may be possible to reduce the order of the modified system 
and subsequently the associated systems. This may reduce to 
some extent the computation time requirement. In certain 
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problems some elements of tiae reduced system matrices may be 
specified. In this case the order of the modified system and 
the associed systems definitely reduce. 

4-2 NUFIExRICAl EXAMPLE 

As an illustration we consider the system equations in 
[25] : _ _____ 

0 1 0 0 ~ 1.0 

s : Z = 0 0 1 0 z + ~1 ,06 u 

0 0 0 1 1.147 

_::i0.07 -0.66 -1.99 -2.J_ _“1-254_4| 

y=[l000jz, z(o)=0 


Our interest is to find a reduced model of second order 
satisfying the performance criteria discussed in this section. 
Further let the problem require the restriction of the structures 
of the reduced system matrices to the following form : 



; = [1 oj z 


and let the reduced model initial condition be given to be, 
x(o) = 0. 

Prom the steady state specification the system is 

obtained as. 



y = [ 1 ,0] X , x(o) - 0 
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where, d = C A”'' b ; 
quantities . 


C, A and b are the original system 


Thus d is a known constant and the parameters to be deter 
mined are and 

let , 

_ A A 

, X2 = X2 , x^ = a^ , x^ = a 2 
with this the modified system equations are obtained as, 

m 

X^ = X2 
* 

X2 = x^ x^ + x^ X2 + d x^ u 

S^: X, = 0 

m 5 

^4=0 

y =[l000jx, x^(o)=o, X2(o)=o 

linearizing this at a point x£IC^[o,t 3, we obtain. 


0 

1 

0 

0 


0 

,, , 






„ «,»■ mmrn mm. 


^4 

x^+du 

X2 

X + 

—X^ X ^ ■" X2 

0 

0 

0 

0 


0 

_0 

0 

0 

0_ 


0 


The functional to be minimized is, 

J = X' © 22 ^ - 
where 

T 

^22 = / ^2' 

0 


1 0 
0 0 


$^2 



1 2 3 
Time in sec. 

FIG. n.1 SYSTEM RESPONSE FOR UNIT 
STEP INPUT 



si 


E, 


'12 




T 

/ ^ 

0 


12 


[y - [i o] Y^] dt 



0 

q 


=• 



'j'. ^ + 



! 

12 

1 

L- 5 




ro 

i~ 


= 

_ 


^ ' 





0 


0 


x^+du Z2 


;^12(o) - 


0 0 
0 0 


r ^3 ^1 " ^2 "" 4 - 


• , 1^(0) = 0 


ior the given system the smallest eigenvalue is -0.2. 
We choose T = = 5 seconds. 


The problem was solved, with initial guess (-1.0, -1.0) for 
( ( o ) , ( o ) ) . 

The reduced system was obtained as. 


0 

f 

A 

0.0 



X 4- 


__g0. 58235 

”1 


JD. 40764 


y = [ 1 ,0j X 

The system response for unit step input is shown in 
figure (I 1.1). 

5. CONCLUSIOIf 


A need for model reduction arises when one intends to 
derive simplified control and estimation strategies. For 
simulation and control of complex processes onehas to go for 
a reduced model; be it from economic point of view or to make 
the important system characteristics amneable. 
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The reduction algorithm discussed in this section can he 
suggested as an alternative scheme for various special problems. 
It can be conveniently used for the general problem, with the 
reduced system dynamics being restricted to the class of Yolterra 
type integral equations. For the reduction of stable LTIVS, 
this algorithm gives a better approximation than that obtained 
eigenvalue retention techniques as in the later case the 
choice of the parameters of the reduced system matrices is 
more restrictive. 



CHAPTER III 


NECESSARY CONDITIONS FOR OPTIMAL CONTROL OP SYSTEMS 
DESCRIBED BY VOLTERRA TYPE INTEGRAL EQUATIONS 

¥ITH PARAMETERS 


1 . INTRODUCTION 

The prohlern of optimal control of systems described by 
Volterra Type Integral Equations (VTIE) was first considered 
by Friedman [2?]. He considered the system equations with 
convolution kernel and derived a maximum principle for the 
case of unconstrained state variables. The cost functional 
had a structure similar to the system equations. Vinokurov [28] 
obtained maximum principle for a system described by general 
VTIB with restricted state variables. Huang [29] has considered 
the general variational problem for a system of VTIB. He gene- 
ralizes the concept of quasiconvexity due to Gamkrelidze [4] and 
derives the general maximum principle based on the multiplier 
rules developed by Neustadt [6]. The problem of optimal control 
of systems governed by ordinary differential equations with 
parameters was considered by Boltyanskii [2]. Das [30] has 
considered the problem defined for VTIB with constant time-delay 
and with parameters. The system equations in his formulation 
are restricted to that with convolution Kernel. 

In this chapter we consider the optimal control of systems 
with parameters and a general kernel. An 


governed by VTIE 
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integral cost functional of a similar structure is considered 
and a set of necessary conditions is derived for the optima- 
lity of a set of parameters and control ba,sed on the basic 
id^:ja of Poiitryagin et al. [2], The following section con- 
tains the problem formulation and the main result in the 
form of a theorem. In Section 3 we esta.blish the validity 
of the theorem. Section 4 contains conclusion and discu- 
ssions . 

2. PRORLEn FORJ'IUMTION ATO NECESSARY CONDITIONS 

Consider a system governed by the following set of 
7TIE : 

t 

X^(t) = g^(t,p) + / h^(t,T) f^(T,x(T), u(t), W) dT (-1) 

^ O 

i = 1 ,2 , . . . , n 

Fiore, u(t)€ID, a sot of admissible controls, and (land w are 
p and q dimensional constant vectors (of parameters) respecti- 
vely. 

The cost functional to be minimized is, 

^1 

J(tj = g°(t-,p) + / h°(t.,T;) f°(T,x(T),u(T) , m) dT (II) 

' ^ ^o 


The problem is to find a set {p*, to*, u*(t)} of para- 
meters and control such that |i*€lMC-R^, w* C. ¥ C u*(t)£l D 



is a minimum, where x*(t) is a solution of equations (I) 
corresponding to parameters p*, to*, control u* and with 
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x*(t^) e_ C and > t^, but otherwise arbitrary- 

Defining x"’(t) = g°(t,|i) + i f°(T,x(T), 

0 u(t) , 0 ) ) d-r 

and writing thii augmanted system in the matrix vector nota- 
tion we have, 

t 

x(t) =g(t,|i) + I H(t,'i;) f(T,x(T),u(T), m) dx ■ (ill) 

"t 

0 

wh'.r:, H(t,T) is a diagonal matrix with the diagonal elements 
Hj_^^(t,T) = h^(t,T), i = 0,1, n. 

In this notation the problem ca.n be stated as fellows ; 

Find the sot { p*, «*, x*(t), u*(t) } 

such th'^t h*CM, (/'CW, x*(t- ) C R^xX- , u*(t) C D and such 

* ‘ I 

O / \ 

tlr’t X (t^j is a minimum, where t^ > t^ is arbitrary and 
x*(t) is solution to equation - (III) with {p*, w*,u*(t)} 
ao thr {>'■', ra IT! i: tor - control set. 

Ft the Ihrmulation of the theorem and its proof the 
full.' wiring assumptions are made : 

(i) The sots M and ¥ are open subsets of R^ and R^ respecti- 
Vu'ly. X^ is a smooth manifold of dimension r^ . 

(ii) D is the class of functions u(t) with the following pro- 
perties 

(a) u(t) is defined and is measurable and bounded in 
Some interval "to ^ t t^ , t^ depending on u. 
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(b) 

(c) 


u(t) e U a subset of R® for anybo t < 

If u C D and its interval of definition is fo,t^] 
then for any^o < t' ^ t" < t^ and for any 
v€:u the function, 


u(t) = 


fu(t) 


V 


also belongs to D. 


if "to ^ t ^ t' pa<t'’< t ;< 
if t' < t t" 


t 


1 


(lil) Let FjjCt) and P„(t) denote the matrices 

|-||.(t,x*(t), u*(t), |;Mt,z*{t),u*(t), m*)] 

respectively and assume, 

(a) H(t,s) P^(s)' to be measurable in (t,s) for 
o ^ s ^ t <00 and 

il(t ,s) P (s) ’ = 0 if s > t 

jL 

(b) For each real number K > 0, ^ a measurable function 
m, such that 

{lH(t,s) P^(s)'ll ^ m(t,s), to v< s ^ t^ K 
t 

J m(t,s) ds is continuous in [t^,E]. 

t^ 

o 

(c) For each compact subinterval I of [t^, ooj and 
each t^ in [ t^, ») , 

Sup.( j ||H(t,s) P^{s)' - H(t^,s) P^(s)’llds}^ 

I 

as t t^ 


o 
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Let T be an operator defined by 

t 

z(t) = T z(t) = f P^(t)' z(t:) ai:. 

*0 

Then by the above assumptions [i-T]’""' exists [16]. 

Further let^ b(t) be an absolutely continuous non-zero vector 

function satisfying the integro-differential eq,uation; 

t . 

d_Jdltj, ^ 

d t , 

Define , 


1 


dT 


x(t):=H(t,t) iKt)+/ hx 

t 

K{t); = f (t,x(t) ,u(t) , -w*) ' H(t,t) i|'(t) 
t 

+ J f(T,x(x),u(T), w*)' ’Ht) d' 

t. 


and 


'j^(t,X*(t), I|;{t),u(t), 0 )*) = f(t,x*(t-),u(t), W*) ' x(t) 


We state the necessary conditions for the above problem 
as follows ; 


Theorem-I : 

If (h*, Oi* , x*(t), u*(t)) is an optimal solution to the 
above problem then there exists a non-zero absolutely conti- 
nuous vector function ^.(t) and the functions x > ^ 3^ as 

defined above such that the following conditions are satisfied; 
(i) ^ (t,x*(t), t^t), u*(t), w*) 

^'Jf(t,x*(t) , ^(t),v, 0 )*) 
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V €1 U and almost all tC [t^,t ] • 

( ii) T{) ^ o 

(iii) ^ ^oj('t) ' -XCt) dt = o 

(iv) K(t^) = - [|| 


(v) 


^Kto) 


-f 


'-dt 


3 \i 


] ' iKt) dt = 0 


n 


^ ^ 'f' ("t^) 'll - 0 , where r) is an arbitrary tangent 

Vc'Ctcr to at x*(t^). 

5. TROOP OP THB0REM~1 : 

i'or the proof the theorem we will require the following 
definition of a regular point of the control function : 


Ffr any measurable function v(t), a ^ t ^ b with -v^alues 
in a s.'.t tJ a point r in (a,b) is said to be a regular point of 
v(t) if f..‘r any neighbourhood F of -^(t) in U and for any 
sequunc,. ,f intervals -I satisfying ^ (I) c, t d I 

«. h-v. ,rz (v-fs) n I)/flO) * 1, wherej*! is the 

Lcbi.'Sgue measure on [a,b]. 

Almost all points of any measurable function v(t) are 
regul'^r. fiirthermore if g(t,v) is a continuous function for 
a 4 t 4: b, then ftr any regular point % of vCr) and for any 


real number a and b, 



75 


T+ P ^ 

J S(t,v(t)) dt = E(f5-a) g(T,v(i;))+ Q(e) 

T+a e 

where o(e) has Its usual meaning. 

L>:-t us est-^blish the variational formula, 

x(t) = x*(t) + e Ax*(t) + o(e) 

wh'..re, x(t) is a si'luticn of equation — (III) corresponding 
t'. the perturbed pa,rameters, control a.nd terminal time. 

Th.. pC‘rturbo,ti-)ns are given by 

il = p* + e 5p 

w = 03* + e fio) 

If t ^ I. , Y . 

if t c I. , -V j 

h “ b + ® 5t 

wher.-, t . < < tp < ... <'Cg <t^ are arbitrary regular 

p:ints f u*(t) and I- denotes the interval t.-e 6t.< t < t . , 

6t . sj. I and e > o is sufficiently small such that I - are 
.) . 

disj-’int intervals. 

L<;t, 2(t): = x(t+e 6t) - x*(t) 

Thun p 

z ( t ) * S ( ^ ^ 6 lO g ( f ) 

£ 6*t 

J H(t+e5t,T) f(T,x(T),u(T), w) dm 
t. 
t° 

- I H(t,T) f('r,x*(T),u''(T), w*) dm 
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or 


2 {t) = ^ 5 ,. + ^ ^ 

^ H(t,Tj^) [f(T]j.,X*(Tj^), vC-tjj.), U*) - 

t:j^< t 

f(T^,x*(T^), u*(tj^), oj*)J e 6tj^ + 

t 

H(t,t) f (t ,x*(t) ,u*(t) , u)*)E6t+ / H(t,T) ] 

t ^ 


+ I f ,U*(t) , t#)dT € 6t + 


J H(t,T) P^(t)' z(t) dT + o(e) 
t ^ 


Let , 


e(t) ati+ at 


3 t 


+ 


^ H(t,Tj^) [f ,v(t:j^) , U)*) 

T^< t 

f(T, ,X*(t,), U*(t^), w*)] 6t 


k 


+ H(t,t) f(t,x*(t),u*(t), to*) 6t + 


i 


H(t,T) [i£('^»2C*(T),U*(T), CO*)]^^ 60) 

3 a) 


+ I f (t,x*(t) ,u*(t) , to*) dx 


6t 


'oj (T)dTe5w 
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¥itht this^ z(t) can be written as 

z(t) = T z(t) + e G(t) + o(e) 
or 

(l-T) z(t) = e G(t) + o(e) 

«> 

or z(t) = e G(t) + ^ eG(t) + o(e) 

CO 

= e [G(t) + I G(t)J + o(s) 

k=i 

Prom this, 

00 

Ax*(t) = G(t) + J G(t) 

k=i 

It is seen that Ax (t’; depends on 
a: = {6^1, 6u) , v^, 6t^, 6t, t' } . Fixing t' and 

using the same points and we get Ax* = X’ Ax*, + X" Ax*,,, 
wherever a = X' a' + X" a". If we take all possible a, the 
vector Ax* = Ax* will fill out a cone K , in the space 

X*, (X*, is the space translated to x*(t')). It can be 

1 / 1 / 

proved that K , is a convex cone in X*, and is denoted by 

1/ u 

the cone of attainability [2] . 

11 + 1 

K , does not fill out the entire space R , as the ray 
I ,, starting at x(t') and going to the negative of x° ~ axis 
does not belong to the interior of s-s this will violate 

the optimality condition. Therefore there exists a hyperplane 
of support r to at its vertex. Thus there exists a 
vector 1 such that for any vector Ax* the inequalities, 

Ax* K , 


(1, Ax*) ;< O 
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(1,1) ^ 0, for some 1 ^ are satisfied. let us take 

'Kt^) = 1. Indeed we can take L as (-1- (g°(t^,[i*)( ,0, 0). 

This gives, 

0 . 

This proves condition (ii). 

¥e now prove condition (i). 

let us choose s = 1, 6t^ =1,6“ = o, 6p = o and 5t = o. 

Define , 

t 

B(t); = / H(t,T) F_(t) B(t) dx + G(t) 

uL 

*0 

with, = 0. 

This implies 

G(t) = 0 for t < T,j 

and B(t) -•= 0 for "^1 

Bor t > 

G(t) = H(t,T)C where, 

C = f(T^,X*(T^), V^ , 0)*) - f (t^ ,X*(Tj) ,U*(X^ ) , «/) 

It follows that 

t 

B(t) = / H(t,'i:) B^(t) B(t) dx + H(t,x,j) C 

x^ x^ < t << t^ 


■^Terentiating, 
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dB(t) 


dt 


u 

H(t,t) P^(t) B(t) + / P^(t) B(t) dT 


+ 


dH ( t , T-j )C 


dt 


We have, 


/ |;^<B(t), ipit) > dt _ f r< dB(t) , 

dt - J L < , il) (t) > 


'1 


+ 


'1 


<B(t), > ] at 


. I 

= / [ <H(t,t) P^(t) B(t}, t/jd) > + 


< f |l(t,T) p (t;) B(t-) ^ 

Ti 

< ^(t,Ti) 0 , i')(t) >] dt - 

dt 


^ [ <B(t), P^(t)' H(t,t) iKt) > + 

q - JL . 

1 ti 

B(t) B (t)' •I' ’Jj (t) dT > ] dt. 

^ dz 

t 

1 t 

= J [< J ^ ” 

'^1 


ti 

^B(t),B^(t)' ! — ’!-'(T)dT> ] 


dt 


-^1 t 

+ f ^(■t,T<)C, 4'(t) > dt 

J < dt ^ 
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^ *1 


/ J < 4'(t) > dt dT 


T. 

t, 


T . 

t. 


Thus, 

t, 

/ 


X 


I i 

; < B(t), i'^(t)' / ^ “ 


, ^ M{t,x,)0, *(t) > 

} d t 


dt 


f < )0, *Kt) > dt 

J dt 


1 


1 


d_<B(t), t(t) > dt = f’ < If 'Ht) > at 

dt x^ 


The above implies that 

<B(t^), i|>(t^) > - <B(t^+o), ^ (x^) > 

= < A x'^ , ^Kt p> ~ < H(t^ ,T^ )C , '1^ (t| ) > 

■tl 

f ‘ )0, ip (t) > dt 

" J dt ‘ 


or 


< H(t,,x,)C, 4.(t,)> + ; < |a{^,x,)C, 4.(t) > dt 

"^1 


= < Ax*, 'l^(t^)> :< 0 


Substituting for G in the above inequality and from the defini- 
tions of X and we have, since x^ is any regular point of 
u*(t) and v^ d U is arbitrary the condition (i) is established. 
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Por the verification of condition (iii) we choose the 
following set of variations : 

ir(t) = u*(t) 

6|i =0 

6 t =0 
and 5 w arbitrary. 


Por this set of variations we have, 
t 

G-(t) = / H(t,T) P(j (t) 6(0 dT 


Defining B(t) as before and substituting for G from the above 

equations , 
t 

B(t) = J H(t,T) [P (t) B(t) + P(^ (t) 6 w ] dT 
t_ ^ 


11 ^'^^= H(t,t) [P^(t) B(t) + Pj^(t) 6 w] 




o 


H(t,t) P^{t) B(t) + / at 


+ H(t,t) P^(t) 6 a> + 


o 


I 


dt 


dH( t , T ) 6 aj dT 

dt 


/ ^ 


dt 


< B(t), i}j(t) > dt = <A 2 ;*, t!>(t.)> - < B(t^+o) , 'f' (t^) > 


= < Ax*, 'Jj (t^ ) > ^ 


0 
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This implies 
t 

1 

< 

dt 


ti 

f < ^(t), ^(t) > dt + J < B(t), ("t) > dt ^ 0 

d t ^ dt 


o 


I [ <H(t,t) Pu(t) 60 ), T//(t) > 

t_ 


or 


+ </ Su) dT, )Kt) >] dt^ 0 

t 

o 


‘'1 

/ < H(t,t) Py(t) 6w , i|)(t)> dt + 

t . t 

f f < (t) 6 “ dT, i|)(t) > dT dt^ 0 

' J d “f: 


t t 

0 O 


or 


/ < H(t,t) Poj(t) 6w, )f)(t)>dt 

t 


“f" 


ti t^ 


/ / . P,(t) 6a) , i)ix) > dT dt X 


or 


dT 


0 




I CPa)(t)' H(t,t) ,|,(t) + P^(t)' J dT] 


dt ^ 0 


or 
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1 
t 

j F(^(t) ’ X (t) dt ^ 0 

Hence, condition (iii) is obviously satisfied since ¥ is an 
open subset of 

Hezt to verify condition (iv) we choose the set of 
variations as; 

u( t ) = u*( t ) 

6p =0 

6oi =0 

and 6t arbitrary. 

With this set of variations we obtain, 
t 

2(-t) = j f (v,x*(t) ,u*(t) , w*)d'r 

^o "" 

+ H(t,t) f(t,z*(t), u*(t), w*)] e 6t + o(e) 

¥e have, ^ 

Ax*(t) = + I f('r)dT + H(t,t)f(t)j 

3”b d[*b 

^o 

where for notational convenience f(‘,x*(‘)> ^*(‘)> ‘^*) is 
represented as f(') 


’1 


6 CO ' j 

\ 

or 


w 


The above equation implies, 
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Az*(t^) = 6t [ 

t 

0 

+ H(t^,t^) f(t^)] 

Thus, 

< Az*(t^), i/;(tp> = 6t ^]' 

■^1 -] 
+ f f(x)' dT+ f(t^)' H(t^,t^) 'l^(t^)' 

^ d. "t/ 

h < “ 

or _ 

5^ r[ Ls.(‘ti > tJ-*)] ' (t^ ) + K(t^ ) 1 ^ 0 

[_ 3 "b “■ 

This implies 

K(t) = - [ 4,{t,) 

Condition (v) can be similarly verified by choosing the 
following set of variations : 

u(t) = u*(t) 

6w =0 
6t =0 

6p ^is arbitrary. 

¥e derive below the last condition. 

let (tJ.*, oj*, z*(t), u*(t), t^ ) be the optimal set. let 
x*(t^) = = (x°(t^), x^ ) . let T^ be the set of tangent 

vectors of the manifold 2^ at the point x^ and let 'y, be the 

1 

r^ -dimensional manifold in R consisting of all points of 
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the form (x°(t^), x) , where Let us pass a ray 

through each point of in the direction of negative 
axis and denote by Q the point set generated by all these 
rays. The set Q is a half-space on an (r^+ 1 ) -dimensional 
space and its boundary points belong to . Since x*(t^ ) 
is an optimal point,- and relative interior of Q have 

empty intersection and hence Q and E. are separated [45]. 

This implies that there exist constants C^, such that 

O' O i 33. 

is in the half -space ^ ^ where (x^,x , . . . jX'^) 

^ a=0 n 

are coordinates in X, and Q is in the half -space I 0 x ^ 0. 

a=0 “ “ 

The (r.+ 1 ) - dimensional manifold ‘‘"7. O Q lies in the half- 
- : 1 n 1 

cc 

space J ^ ^ ^ consequently in the hyper-plane 


n 

I 

a=o 


a=o 


o. With this, i|)(t^) can be taken as equal to 


(C^, C^, ..., . Since (o, ..., p^) is an element of 

for any tangent vector (p^ , ..., p^) to X^ , the relation 

n n 

^ i|»i^(t^) x*^ = o reduces to ^ 

a=o i=1 

Hence the validity of the theorem is established. 


4. COHCIUSIOH 


In the above theorem the sets M and ¥ were assumed to 
be open subsets of and r'^ respectively. In case the sets 
M and ¥ are smooth closed subsets, a similar theorem can be 
established, where the equalities (iii) and (v) in the 
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theorem 1 sire replaced by the following inequslities res- 
pectively . 

(iii) 6 W J I'j^(t)' X(t) dt ^0 
t^ 

(v) 6|i' [ )]’ ip(t^) + 

^ *^dt dt ^ 0 

■^o 

Here the variations 6p and 6oj are restricted to be 
contained in the tangent cones of (M-p*) and (¥- u*), at the 
origin, respectively. 



CHAPTER IV 


OPTIMAL COITROL OP SYSTEMS DESCRIBED BY DELAY- 

DIPPERENTIAL EQUATIOHS 


1 . IHTRODUCTIOH 

Application of Pontryagin's maximum principle to the 
optimization of time-delay systems results in a system of 
coupled two-point-boundary value problems with both delay and 
advanced terms [pj. Appropriate numerical techniques have to . 
be used for solving these problems. 

Eller et al. [51 J have presented a technique for solving 

the optimization problem with quadratic cost functional that 

2 "t* 

requires simultaneous solution of 2n +n equations for an n 
order system using a nontrival numerical technique [32], This 
method has also the disadvant8,ge that it generates open-loop 
control. Another approach for the optimization of linear time- 
delay system is to transform the problem in to an equivalent 
linear non-delay problem. This approach, as developed by 
Slater and Wells [33] , allows only the integral of a quadratic 
form of the control, but not the state in the cost functional. 

The computation of sub-optimal controls, for linear time- 
delay systems has been considered by several authors. A section 
of these results is based on a continuation or sensitivity ana- 
lysis concept. Inoue et alj [34] have used this approach to 
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obtain a sub-optimal control for stationary linear systems with 
small delay in the state. They have expanded the control in a 
MacLaurin serie.® in the delay and obtained the series coefficientE 
from the solution of simple TPBVPS. Jamshidi and Malek-Zavarei 
[ 35 ] used a Maclaurin series expansion of the control in a sen- 
sitivity parameter and obtained the series coefficients from non- 
delay system computations. The sub-optimal control they obtained 
is in the form of an exact feedback term and truncated series 
forward term for stationary linear system with time-delay. The 
result has been extended to the case of multiple delay in state 
and control by Malek-Zavarei [36]. 

Gracovetsky and Vidyasagar [38] have proposed an iterative 
scheme for the optimization of linear non-stat ionary system with 
delay in state. They have extended the result to optimize 
systems described by nonlinear delay differential equations, with 
delay appearing in state [40] and also to neutral systems [ 39 ] . 
Recently Malek-Zavarei [3?] has extended the results to optimize 
a more general class of delay systems. He has considered linear 
system with multiple delay in state and control. He also extends 
the result to nonlinear delay systems with time-varying delay in 
state and control. 

Each iteration in Gracovetsky et al, ' s scheme consists 
of solving an optimxization problem with ordinary differential 
equations as constraints. In the k optimization problem the 
delay term in the system equation is substituted by the solutions 
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"t/ I q. 

obtained from the ( k-1 ) iteration. In each iteration one 

requires to solve 2n - ordinary differential equations with n- 

"til 

initial and n-final conditions given, for a n -order system. 

This indeed is an easy task as compared to other methods. The 
method also results in a control which is partially closed-loop 
and partially open-loop. 

Por the convergence proof of the sequence of optimization 
problems, Gracovetsky et al. have proposed a lemma based on the 
Picard's method for existence of solution of ordinary differen- 
tial equations. The lemma seems to be inadequate to ascertain 
any conclusion regarding the convergence of the sequence of opti- 
mization problems. Each term of the sequence consists of equa- 
tions with both initial and final values given, thereby forming 
a TPBVP and in the lemma each term of the sequence comprises of 
an initial value problem. 

Further as it is clearly seen, if at all the sequence so 
obtained converges, in the limit it does not, in general, satisfy 
the maximum principle corresponding to the delay system. One 
is totally uncertain, whether the control obtained through the 
proposed optimization sequence is sub-optimal or not. The 
method cannot be applied with any confidence, though in some 
particular cases it may give near optimal controls. 

In this chapter we present an iterative scheme to determine 
the optimal control for a system described by linear time-delay 
equations with quadratic cost functional. The control obtained 
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is partly closed-loop and partly open-loop. The convergence 
proof for the iterative scheme is given for systems with 
certain restrictions. The iteration scheme is expected to 
converge, in general, wherever the TPBVP corresponding to the 
system has a solution. 

The following two sections contain the main results of the 
chapter. In Section 2 we prove a lemma essential for the proof 
of the theorem in Section 3. Section 4 contains a numerical 
example illustrating the method. The last section (Section 5) 
contains extensions and discussions. 

2 . Lemma : 

Let , 

g(t) = -A(t)' g(t) - h(t,x(t-6), x(t+6), g(t+6)) 

x(t) = A(t) x(t) + f (t ,x(t-5) ,g(t) ) (2.1) 

xCR^, g^E^ and'V't C [0,T] 

with boundary conditions, 

x(t) = Ti(t) -6 ^ t ^ o 

x(t) =0 T<t^T+6 

g(t) =0 T^t^T+6 

be a given system; f and h are Lipschitzian and A is a piecewise 
continuous matrix of appropriate dimension. ri is an arbitrary 
given function in C E— 6,0j ; the space of all continuous fun— 
ctions in [-6,0] with range in 
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Then the sequence of vector functions gH defined 

iCF 

g°(t) = 0 O^t^T+6 

x°(t)= 'I'(t,o)ri(o) 0 t-^ T 

x°(t) = 'n(t) -5 t 0 

x°(t)=0 T<t<T+6 

T 

= J [ $ (tjT)”^ h(i:,x^'''* (t-6) (t+ 6) ,g^‘"'^ (t+ 6)) dx 

t , 

'V't £T[0,T] 

t 

X^(t) =^(t,o) 1l(o) + / ^(t,T) f (XjX^"'' (t- 5) ,g^(T)) dT 

o 

g^(t) = 0 ; T -< t ■$ T + 6 

x^(t) = 0 ; T < t ^ T + 6 

x^(t) = q(t) ; -6 ;< t $ 0 

(where f|)(t,T) is the state transition matrix corresponding to 
A(t)) converges uniformly to the solution of equations (2.1), 
if the lipschitz constants for the functions h and f are suffi- 
ciently small. 

Proof : 


let, 
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M; = Sup. \\^ (t,T) I I 

t,Tc:[ o,tJ 

= Sup. 1 1 p(t}| [ 

t€:[~6,o] 

IT; = Max[F,H] 

where, P and H are the Lipschitz constants of the functions 
f and h respectively, i.e., for every (t,x^,y^,z^) and 
(t,X 2 >y 2 > 22 ) in the domain of h, 

I |h(t,x^ ,y^ ,z^ ) - h(t,X2,y2»22) 1 I $ H( I [x^-X2 I I + ijy^~y2M 

+ I I 1 ) 

and for every (t,x^,yp and (t,X 2 >y 2 ) in the domain of f, 

1 If (t,x^ ,y^ ) - f (t,x2,y2) I i ^ P- ( ! Ix^-X2[ 1 +11 y^~y2l 1 ) • 

Here, 1 1 • | | denotes the Euclidean norm. 

Purther let, a; = MHT ^ 1/6 

Now, 

T 

! I g*' (t) - g°(t) I I ;< MN J (I i x°(t- 6) j I + I jx°(i:+6) j| ) dr 

t ij 

^ 2 MNl J dT < 2Ia 

t ^ 

|lx'*(t) -x°(t)il -j: MN J ( I |x°(i;”6) i 1 + 1 1 (t) I I ) dr 

0 

^ lOTt + 2La^ 3La 
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T 

I i g^(t) - (t) I I ^ m I (li (t-6)"X°(t-6) [ 1 

t 

+ ! I (t+6) - x°(t+6)| I +[ I (t:+<5) -- g°(T+6) j |) dx 
:< 3 OTT- 3La $ L-(3a)^ 

I I x^(t) - x^ (t) I OT / ( ( jx^ (x~6) - x°(t-6)| I + \ \ g^{x) 

o 

-g^(T^)i!)dT^ ?E'Tt(51a + L(3a)^) 

^ l(3a)2 

Similarly by induction one can show, 

||g^(t) - g^''^(t)| I ^ L.(3a)^ ^ ^ ^ 

llx^(t) -x^-‘'(t)|l ^ L.(3a)^ 4 1. ^ 

Applying the triangle inequality, for any r 

1 1 g^^'^Ct) - g^(t)| I ^ 1 . (1 + 1 + ^ + ... + -^) 

I 1 x^^^(t) ~ x^(t) ! ! ^ L. ^ 

Therefore the sequence is uniformly convergent. 

3. PROBISM STATEMENT AND METHOD OE SOLUTION 
Consider the linear delay system, 
x(t) = A(t) x(t) + C(t) x(t~6) + B(t) u(t),'\5rt ^ 0 


( 3 . 1 ) 
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x(t) = r)(t) , -6 ^ t << 0 

uCR™ and the system matrices are piecewise 
continuous xfith appropriate dimensions. p£:C^[~6,o] is an 
arbitrary given function, 

Let, 

T 

Jt= i- x(T)' P x.(T) + i- J [x(tV Q(t) x(t) + u(t)' R(t) u(t)J dt 

0 

where , 

P,Q and R are matrices of appropriate dimensions. F is 
positive semi-definite, Q is symmetric positive semi-definite 
and piecewise continuous and R is symmetric positive definite 
and piecewise continuous, C 

The problem is to find a control u(t), o ^ t ^ T, which 
for fixed final time T and free final state x(T) minimizes the 
functional J. 

Theorem : 

Consider the sequence, 
g°(t) = 0 o-ct^T+6 

x°(t) = [A(t) - S(t) Z(t)]x°(t), x°(o) = p(o), t C [0 ,t] 

x°( t) = r)(t) , -6 ^ t 4 : o 

= -[A(t) - S(t) E(t)]' g^(t) - K(t) C(t) x^'Ut-d) 

- G (t+6)’ K(t+6) x^”'’(t+6) - C(t+5)' g^“'’(t+6) 

0 >5 t T-6 
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g^(t) = - [A(t) - S(t) K(t)]' g^(t) ~ Z{t) C(t) 
g^(T) = 0 T-6 ^ t ^ T 

x^(t) = [A(t) - S(t) E:(t)] x^(t) - S(t) g^(t) + C(t) x^''^(t-6}^ 
x^(t) = r)(t), ~6 < t^iO. O^t^T 

i 1^2^ m 0 m f 

Here, S(t); = B(t) R "'(t) B(t)' and K(t) is the symmetric 
positive definite solution of the matrix Riccati Equation, 

K(t) + Z(t) A(t) + A(t)' E(t) - IC(t) S(t) K(t) + Q(t) = 0 

V- tC[0,Tj 

with boundary conditions, E(T) = F 

Let $(t,i:) be the state transition matrix corresponding 

to the system matrix [A(t) - S(t) K(t)]. Then if j [5 (t,T) ] j, 

llS(t)l|,ll C(t)|t and |lK(t) M are sufficiently small 

the sequence { x^ } (where x^cC [0,T] is a solution 

th 

of the equations in the i iteration ) converges 

to' the optimal solution x'^, of the problem and the 
optimal control u* i® obtained as, 

u*(t) = ~R“^(t) B(t)' K:(t) x*(t) + g(t), o ^ t ^ T 
Here g is the limit of the sequence } 

Proof : 

The convergence is obvious from the lemma stated in the 

i * 

previous section. Also the limit of the sequence { x }, 
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satisfy the set of equations^ 

g(t) = - [A(t) ~ S(t) E;(t)j’ g(t) - E(t) C(t) z*(t-5) 

- C(t+6)' K(t+6) x*(t+6) - C(t+6)' g(t+6) 

o ^ t ^ T ~ 6 

g(t) = - [A(t) - S(t) K(t)j' g(t) - K(t) C(t) x*(t-6) 

T - 6 ^ t ^ T 

g(T) = 0 

i*(t)= [A(t) - S(t) K(t)] x*(t) - S(t) g(t) + C(t) x*(t-6) 

o ^ t <6 T 

X*(t) = Ti(t) , -5 .< t o. 

Applying the maximum principle to the given 
system and substituting [K(t) x*(t) + g(t)J for the auxilary 
variables along with the matrix Riccati equation one obtains 
the above set of equation as the sufficient optimality criteria. 

4 . mJi^ffiRICAI ESAlvjPlB 

Consider the example of a typical control problem arising 
in the chemical and petrolium industries. The block diagram of 
figure (IV. 1) depicts a refining plant. 

P. and P„ represent the feed rate, in pounds per hour, of 
the raw materials A and B respectively. The reaction in the 
reactor is exothermic and the reactants cooled to a desired 
temperature in the heat exchanger. The undesirable products 
settle out of the reactant mixture in the decanter. Binally 




FIG.IV.1 BLOCK DIAGRAM OF THE REFINING PLANT 



FIG.IV.2 SIMPIFIED BLOCK DIAGRAM OF THE 
REFINING PLANT 
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transformation. The block diagram then reduces to one as shown 
in figure (IV.2). 

With numerical values given in [42] and 10 mts. recycle 
time the linearized model is obtained as [41j, 

x(t) = A x(t) + 0 x(t-"l) + B u(t) 
where the system matrices are. 


-4.95 

-1 .01 

0.0 

0.0 

-3.20 

-5.30 

-12.8 

0.0 

6.40 

0.347 

-32.5 

-1 .04 

0.0 

0.833 

1 1 .0 

-3.96 

1 .92 

o 

• 

o 

0.0 

0,0 

0.0 

1 .92 

0.0 

0.0 

O 

• 

o 

0.0 

1 .87 

0.0 

0.0 

0.0 

0.0 

0.724 


1 0 

B = ^ ^ 

0 0 

_0 0 __ 

Here the time unit is 10 mts. The various state and control 

variables represent the following physical quantities : 
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x<| : deviation in the weight composition (dimensionless) 

of the reactant A from its nominal value. 

X 2 : deviation in the weight composition of the reactant B 
from its nominal value. 


X 


3 


deviation in the weight composition of an intermediate 
product . 


X, 


u. 


deviation in the weight composition of the product P 
from its nominal value. 




6 P 


u 


B 


'2 • “ 6 

K 


, where Vp is the pound volume 


of the chemical reactor and 6 and 5 are respecti- 
vely deviation in the feed rate of A and B from their 
nominal values. 


A typical time response of the uncontrolled system, with 
ri^(t) =0.1, = B^Ct) =0; t I -i ,Q] ^ is shown 

in figure (IV.3). The response is sluggis. 


As a large volume cf chemicals are being processed and 
the quality of the product is to be maintained, any deviation 
from the nominal values can be very costly. This makes the 
natural response of the system unacceptable and a controller is 
to be designed to rapidly diminish the deviations in the reactant 
compositions. 


The control functions were computed using the iterative 
scheme presented in the previous section for the following choice 
of Q,R,P and T : 



XU XU 
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Q = 


1 

0 

0 

0 


0 

1 

0 

0 


0 

0 

1 

0 


0 

0 

0 

00 


R = 


1 

0 


0 

1 


F = [ oj , T = 5 units 


, T inputs as presented in 
The system response with the contr^^ 

a. • svstem performance. 

Pig. IV. 3 depicts the improvement lu tn- y 

5. GONGIUSION 

o-u • o phenter can directly he 
The technique developed in this r 

varying delays in state 
extended to multiple nonlinear time-va y s 

variables. 

+ =^ is Quite easy to apply as it 
The iterative scheme presented is q 

. j 4 -p-ppnent ia.1 ©quations 

requires solution of a set of ordinar;S 

^ /j-nanv diff equations 

with final value and a set of ordinary 

The Riccati equation is 

with initial value in each iteration. 

each iteration step requires 
required to be srlved once only and eacn 

^ +i«l equations. The example 
the solution of 2n~ordinary differential equ 

ori slsorithm works even when 
considered depicts that the proposea arg 

nroof is 

the smallness conditions used in the con ^ 
being satisfied. 

^ p the 2n””func t ions 
The algorithm requires the storage u 

2 ' r TT One ce.n follow the 

X and g in a.d dition to the n -functions 

v,-r>ip for the solution of the 
following alternative iteration scheme 

optimization problem ; 
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g^(t) 


g''(T) 


g^(t) 


x^(t) 


[A(t) > S(t) K(t)J' 

T-6 ^ T 


E(t) C(t) x^”^(t-6). 


= 0 


-0(t+6)' K(t+ 6 )x-’(t+« -c(t+a)' 

o $ t ^ T-a 

^^ i/ + ^ s/t) g^('t) + c(t)x^(t~6) 
[A(t) - S(t) K(t)] X (t) - S(ti g 

o ^ t ^ T 


x^(t) = n(t) , -6 ^ t < o 


i = 1 ,2,3, ... 


This scheme requires "tti-® 


of n-f unctions x and 


n 


■-function K. Further as the rens 


wed value of the advanced 


„+^.^nc! for R and the 
term in g is used in solving the equ - 

^ -in V for solving the equations 
renewed value of the delay term m 

' A. -p nonversence may he better, 

for X is being ’Jised the rate of con g 



CHAPTER Y 


DETERHINATIOH OE OPTIMAL IITITIi?L PHHCTIOF AHD 
PARAIASTSRS IN A SYSTEM DESCRIBED BY DELAY- 
DIPPERENTIAL EQUATIONS 


1 . INTRODUCTION 

Many physical systems are represented by a system of 
Delay-Dif f erential Equations (DDE) with adequate accuracy. In 
such systems various problems (e.g., modelling, model reduction 
design problems etc.) may require the determination of certain 
system parameters as well as the initial functions for a given 
system of DDE so as to obtain certain desired system behaviour. 

In this chapter we consider the problem of determ-ining the 
initial functions and parameters in a given system of DDE so as 
to minimize a functional of various system variables. Mathema- 
tically the problem considered can be stated as follows : 

Problem (P) : 

let , ' 

x(t) = f(t,x(t) , x(t-l),a), t o (1.1a) 

x(t) = r](t), -1 ^ t ^ 0 (1.1b) 

xCCJ-1,t], aCR“, DCC^[-1,0] 

be a given system. Here, 0^[a,b] denotes the space of all 
continuous functions on the interval [a,b] with range in R . 
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Let , 

X 0^[0,T] X R 

"be a given functional. 

The problem is to determine -1 , 0] , x*C1C^[0,T] 

and a*CIR™ such that J attains a minimum among all (p,x,a) 
satisfying the system equations (1.1) and pC XCC^[ -1 , 0] ; 
where Z is a 1-dimensional subspace of C^[-1,0j defined as; 

= { TlCCj^C-1 ,0j : p(t) = ix.e(t) Vt €. [-1 ,0] , 

is any nxl constant matrix, ecC^^C-IjO] and 
{ e^^ ; i = 1 ,2 , . . . , 1} is a given set of linearly 
independent elements of C^[-1,0]. Here, e^ denotes the 
i component of e ). 

In the above problem we seek the optimal initial function 
in a finite dimensional subspace of C^[-1,0]. For all practical 
purposes, the space of continuous functions can be approximated 
a finite dimensional subspace of it. If the dimension 1 of 
^ in problem (P) is chosen sufficiently large we obtain a near- 
optimal solution for the initial function in the space C^[-1,o]. 

This formulation of the problem is motivated by the fact 
that it reduces the problem of determination of the optimal 
initial function to that of determining a finite set of para- 
meters . 

In Section 2 we discuss the existence of an optimal solution 
(p*, X*, a*) of the above problem (P). In the next section 



(Section 3) a set of necessary optimality conditions is deve- 
loped in the form of a boundary value problem and an iterative 
scheme is proposed to obtain a local minimum of J. ¥e illustrate 
the method developed in Section 3 by a numerical example in 
Section 4. Finally some extensions of the results in the pre- 
vious sections and discussions are given in Section 5. 

2, EXISTEITCB OP SOlUTIOlf FOR PROBIBF (P) 

In this section we present some sufficient conditions for 
the existence of a solution of the optimization problem (P). 

As it will be seen from the following example the problem (P) 
as such need not always have a solution. 

let the system equations be given by, 

x(t) = t ^ o (2.1a) 


x(o) = 1 


(2.1b) 


and the functional J be, 

T 

J = i (I - x( t ) )^ dt 
0 


Then we obtain, 


J 


1 

^ ( 1 + a)^ 


Since lim. J = 0, there is no finite value of a for which J 

CC -4“ 4* CO 


attains its infimum. 
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This simple problem illustrates the need to ensure the 
ezistence of a solution of the problem (P). It is clear that 
we need to impose certain restrictions, additional to the mere 
ezistence of a solution of the initial value problem (2.1), on 
the function f and the functional J. In this connection we 
present below two theorems which assu^res the ezistence of a 
solution of the problem (P). 

Theorem~1 : 

let the function f and the functional J in problem (P) 
satisfy the following conditions : 

(i) The function f(t,z,y,a) is continuous with respect to all 
its arguments, lipschitzian in (z,y,a),* i.e,, 

3 1 > 0 3~ for every (t,z^,y^,a|) and 

(t,Z 2 ,y 2 ;“ 2^ domain of f, 

If ( t,z^ ,y^ ,ap - f(t,Z2,y2>«2^ ■'■|yi"’y2^ 

+ “"^2 i ) 

(1 . j denotes the Euclidian norm) 

and is such that there is a solution of the initial value 
problem (1.1) in [0 ,tJ for all (p,a). 

(ii) The functional J is continuous in all its arguments and 
satisfies the following conditions t 

a) J is bounded from below 

b) J 00 as j a| -> 00 

c ) J “ as 1 p| 00 
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Then 3 determining a solution of the optimi- 

zation problem (P). 

Proof : 

Let , 

|3: = inf. J ((i,x,a) 

where the infimum is taken over all ((i,x,a) satisfying 
equation (l.l). Then 3 ^ sequence { in 

X C^[o,T] X R^ satisfying the system equations (1.1) 
3~J^(:= J(p^,x^,a^)) is monotonic decreasing and Lim J^=P. 

i -►oo 

Since J is bounded from below, we have, 

-“< p ^ J^<J°V’ iCR . 

Prom conditions (iib) , (iic) and the above inequality 

we get that and {a.} are bounded. 

iCR 

By equation (1.1) and using condition (i) for o ^ t ^ T 
we have , 

t 

lx^(t)l 4 I e(o)| + / |f(s,x^(s), x^(s~l),o:^) 

° t 

- f(s,o,o,o) Ids + I / f(s,o,o,o) ds | 

0 

H3 e(o) I + T. Ifex |f(t,o,o,o)l 

tC[0,T] 

t 

+ 1 J ( 1 X^(s)l + I X^(s-1 ) I + I I) ds 

o 

< I p^ e(o)l + T.Max. 1 f(t,o,o,o) I + l.T.la^l 

tC[0,T] ^ ' 

• • "fc • 

+ L J 1 s-1 ) I ds + I J 1 X', (s)| ds + L J [ x^(s) 1 ds 

0 


o 


o 
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^ hi e(o) I + T. Ifex. If (t, 0,0,0) I + L.T. I a I + I. 1 • I 

tC[0,Tj 
t . 

+ 21 / h (s)j ds 


o 

t 


M([i^,a^) + 2L / |x^(s)| ds 

o 


Obviously, M is a continuous function of a^s and ^i^s. Since 


a^s and [hs are bounded ; 




Thus, 


I e(o) 1 + T.Bfex. I f(t,o,o,o)[ + l.T. I I 

t€:[o,Tj- 


+ L hi""! • !ie|i 


By Gronwall's lemma, 

|x^(t)| ^ M e^ V" i— A tC[0,T] 


Further, 


d ( t ) 


u 


1=1 f(t,x^(t), x^(t~l), a^)| M ■V’tC[0,Tj 

since ([i^,x^,a^) are bounded and f is continuous with respect 
to all its arguments. 

Thus { ih,x^,a^ is uniformly bounded and{x^}^^j^ is 

equicontinuous . Ascoli's lemma ensures that a subsequence 
i, 

{x h of { x^} .£ri\T converges uniformly in [0 ,t]. Taking 

ij^CN ijj. il5- 

the corresponding subsequence { p h CIU ^i CN 

"k" k 


Ic'- -"k^ 

{|i^}i^j^ and ^ respectively, we have that the subsequence 



subsequence by (p.*,x* 
the equations ; 

X ^(t) = ^ e(o) + 


converges. Denote the limit of the 
,a*). Now taking limits on both sides of 


t 

I 


f(s. 


'k 


(s), X (s-1), cc ds, tC[0,T] 


o 


X 


'(t) 




e(t) 


tC[-1 ,0j 


We obtain, 

"t/ 

x*(t) = e(o) + J f(8,x*(s), x*(s~l),a*) ds, tC[0,T] 

0 

X* ( t ) = e ( t ) , t C [ - 1 , O] 

Hence, (ii*,x*,a*) satisfies the system equations (l.l) and 
similarly, J(^*,x*,a*) = p is ensured by continuity of J with 
respect to its arguments. 

This proves that (p*,x*,a*) determines an optimal solution 
of the problem (P). 

In the next theorem we consider the minimization of the 
functional J of the problem (P) when the initial function p is 
a given (fixed) eleraent of C^[~1,o]. This turns out to be a 
special case of the problem (P) and we need to ensure the exi- 
stence of the optimal solution (x*,a*) that minimizes the fun- 
ctional J for a fixed p = hC C^[-1,0] and satisfies equations 

( 1 . 1 ). 

Theorem 2 : 

let the function f and the functional J of problem (P) 


satisfy the following conditions % 



1 1 1 

\ 

(i) The function f(t,x,y,a) is continuous with respect to all 

its arguments and lipschitzian in (x,y,a); i.e., 3^^ ^ ° 3^ — 

for every (t,z^,y^,a^) and (t ,x^,y 2 ,cc 2 ) in the domain of f, 

If(t,x^ ,y^ ,a^ ) - f(t,X2,y2,a2) ( <<: l( Ix^-X2 1 + |y^-y2 I ^ 
and is such that there is a solution of the initial value problem 
(1.1) in [0 ,tJ with p = p and all a. 

(ii) The functional J is continuous in all its arguments, bounded 

from below and | a | -► «> J -»■ " 

Then 3(x:*,a*), Cjj^rOjT] and a*C such that J 

attains a minimum among all (x,a) satisfying equations (1.1) for 
a fixed p ( = p C C^[ -1,0]). 

Proof : 


let, 

p : = inf . J ( X , a ) 

where the infimum is taken over all (x,a) satisfying equations 
(1.1) with p = p. Then 3 9- sequence ^ 0j^[0,T] x 

satisfying the system equations (1.1) with p = P 3-J (:= J(x",a"-)) 
is monotonic decreasing and Lim = p. Then by similar argu- 

i-»-oo 

ments as that of Theorem-1 , one obtains a convergent subsequence 
{x , a , whose limit (x*,a*) satisfies the integral 

equation, 

t 

x*(t) =p(o) + J f(s,x'^(s), x*(s-l),a*) ds, t€)[o,T] 


x*(t ) = p( t ) , t€ [-1 ,0] 
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Hence, (x*, a*) satisfies the system equations (1.1) with 
initial function ri = r) and J(x*,a*) = (3. ^ 

3 . NEC E S S ARY C ONEI T 1 0N3 

In this section a set of necessary conditions is developed 
in the form of a boundary value problem, to be satisfied by a 
solution (p*,x*,a*) of the problem (P). Then a method is pro- 
posed to determine a local minimal solution of the problem using 
these conditions. 

¥e shall impose the following restrictions on the function 
f and the functional J for the derivation of the necessary 
conditions % 

(i) The function f is continuous in t, twice continuously 
differentiable with respect to (x,y,a) and is such that 
there is a solution of the initia,! value problem (1.1) in 
[o,T] for all (p,a). 

(ii) The functional J has an Integral representation, 

T 

J = J g(t,x(t), x(t-l), a) dt and 
0 

g(t,x,y,a) is continuous in t and twice conti- 
nuously differentiable with respect to (x,y,a). 

Now let, 

t 

z(t): = J g(s,x(s), x(s-1), a) ds (3.1) 

0 
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]\fe.king use of the continuous differentiability of the 
solution [ 15 J xCC^Co,T] of the system equations (I.I) with 
respect to the parameters p and a it is seen that z(T,a,p) 
is continuously differentiable with respect to (p,q:). So the 
necessary conditions for optimality ere, 




n f 3 " 1> •••^m {3»2s) 


3z (T,P,oc) _ 
8a. " ^ 


m 


(3.2b) 


1 

In order to make use of the above necessary conditions to 
determine the optimal parameters, we consider the following 
system of differential equations ; 


= f (t,x(t) ,x(t-1 ) ,a) 


(3.3a) 


d / 3x(t) \ _ r^-i 8x(t ) , fifl 9x( t~ 1 ) 

dt ^ 9^. . + LgyJ g _ 


(3.3b) 


A. ^ r^i .8x(t) j-Kl 3x(t-1 ) , 3 f 

dt ^9a^ Lgx^ 9a^ 9 a^^ 9 


(3.3c) 


dt ^8 p. . ^ - ^8 x-^ 

1 J 


8x(t) 

8 p. . 


+ 


‘-8yJ 


8 


x(t-1 ) 



d / ^z( t) V 

at 



^x( t--1 ) 

3 


+ 



(3.3d) 


(3.3e) 


1 ; 


1 , . . . , m. 


for tC[0,Tj and i = 1, 


II y j = 1 > . . . , 
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If ([A*,x*,a*) determines a solution of the optimization 
problem (P) and the function f and the functional J satisfy 
conditions (i) and (ii) respectively. Then must 

satisfy the system of differential equations (3.3) together 
with the following boundary conditions : 


x(t) = p.e(t) 


axiil 

3 u. . 


3x(t) 

3 


e.(t) 

0 


“1 t ^ o 
i = 1 , . . . , n 
3 1 » 4 

k = 1 , . . . , m 


3 z(o. u.g) _ 

3 [i. . - ^ 


3 % - 0 


i 1;^ • • • f XI 

3 = 1, 1 

k = 1 , . . . , m 


3 \i. . 


^_Zi ( T , p, (x) _ Q 

^k 


i = 1 , . . . , n 
3 ~ 1> 1 

k = 1 , . . . , m 


(3.4a) 


(3.4b) 


(3.4c) 


The initial conditions (3.4a) are obtained from (1.1b) and 
(3.4b) are obtained from the integral equation (3.1). The 
final conditions (3.4g) are the necessary optimality criteria 
(3.2). 


We Justify the above assertion as fellows : 
let , 



115 


t 

x(t,'il,a) = |I.e(o) + J f(s,x(s), x(s-l), a) ds, te[o,Tj 

° (5.5a) 

x(t,|a,a) = ]I e(t), tC[-1,0] (3.5b) 

and ^ 

^(t,]!,^) = J g(s,x(s), x(s-l),a) ds (3.5c) 

0 

for some ([i,a)dR^^^ x R^. 

(3.5a) is a solution of (l.1a), with initial function 
(3.5b), for the parameter values (]I,a). (3.5c) is the equation 

(3.1) with parameter values (II, a) and for t = 1 ,• it represents 
the functional J for parameters (Pja), Prom the differentiability 
assumptions on f and g and noting that the solutions of (1.1) 
and (3.1) are continuously differentiable with respect to the 
parameters (p,a), by taking partial derivatives of (3.5) with 
respect to (p,a) at (p,a) first and then the total derivative 
with respect to t, one obtains the system of equations (3-3) 
along with the initial conditions (3.4a) and (3.4b), Now if 
(p,a) is a solution of the problem (p), in addition z(T,"iI,a) 
must satisfy the necessary conditions (3.2) and hence the final 
conditions (3-4c). Thus the assertion is justified. 

As can be seen in system (3.3), (3.4) there axe 

2 p 

(n+n .1) + n.m + n.l + m) equations and (n+n'^ .1+n.m+n.l+m+nl+m) 

boundary conditions. The (n.l+m) excess conditions will help 

in the determination of the (n.l+m) parameters (p,a). 



1 16 


It is to be noted that the system of equations (3.3) with 
initial conditions (3.4a) and (3.4b) posses a unique solution 
for fixed (p,q:) by the twice continuous differentiability con- 
ditions on f and g with respect to (x,y,a). 

The above boundary value problem can be solved by augmen- 
ting the system equations by the (n.l + m) additional equations, 


d |i. . 

dt 1 = 1 , . . . , n ; j = 1 , . . . , 1 

d a 

— 0, k— 1, ,..,m. 

and then using any available technique for solution of boundary 
value problems for ordinary differential equations. 


Below we propose an iterative scheme to obtain a local 
minimum of J using the system of equations (3.3) along with 
the boundary conditions (3.4). 

The solution of (3.3) with initial conditions (3.4a) and 
(3.4b) at t = T determines the gradient of the functional 
J(; = J(p,a)) for a given set of parameters (p,a). Hence any 
minimization technique using the gradients can be applied to 
obtain a local minimal solution (x*,a*). Here we use a negative 
gradient method. 


To start with choose 
ponent of the vector 


(lx^a°) 

T,p°,a°) 


such that at least one corn- 


er 


iz ( T , 4 
8a 


0 N 
) 


IS non- 


zero . 
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Choose an acceleration factor C < 0. Let he 

already determined. Set q 1^ » a ) 

+ C ^ 

The iteration is stopped if ) = J([i^,a^) and 

IL 1 

( |i ,a ) determines a local minimum of J. 

The acceleration factor C may he varied in any intermediate 
step depending on the rate of convergence. 

4. NUMERICAL EXAMPLE 

Ae an illustration of the above method we consider the 
following model reduction problem. 

Eor the chemical process discussed in Chapter 4, our in- 
terest is to obtain a reduced model of a specified structure 
and determine corresponding initial function so that the model 
best approximates the deviation in the weight compositinn of 
reactant A from the nominal value for some known system dis- 
turbanc e . 


Below we give a mathematical formulation of the problem : 


Consider the 

uncontrolled 

process ; 

with u 

representation is 

9 





-4.95 


-1.01 

0.0 

o.o” 

11 

-5.20 


-5.50 

-12.8 

0.0 

6.40 


0.547 

-52.5 

O 

1 


0.0 


0.855 

1 1 .0 

-5.9£ 


The system 


x(t) 
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1 .92 

0.0 

0.0 

o 

• 

o 




0.0 

1 .92 

O 

• 

o 

0.0 



+ 

0.0 

0.0 

1 .87 

0.0 

x( t 



__ 0.0 

0.0 

0.0 

0.7^ 

1 

: the 

system disturbance 

be given 

as ; 



x^ (t) 

= 0.1, 

~1 t 





Xj_(t) 

o 

« 

o 

11 

“1 ^ t 

0 ; 

i = 2,3,4 




We consider a first order reduced model for the above system 
given by ; 


x(t) = x(t) + x(t~1), t ^ o 

x(t) = -1-5^ t^ o 

The functional to be minimized can be justifiably chosen as; 
T 

J = T f (x^(t) - x(t))^ dt; T is chosen sufficiently 
0 


large . 


The system of associated equations is obtained as follows 


dx(t) 

dt 


= a^x(t) + a 2 x( t~1 ) 


dt 



M-b) 

1 


^ x( t-1 ) 

'2 


d_ ('ix(t)N 
dt ^3ii2 


a 


ix(t) 
1 3 [ 1^2 


+ a. 


9 1^2 


dt 
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dt ^ ^ 1 da^ ^ “2 aa^ 


ft Iff"’ 


ft (3-1^'"’)= w*) 1 ^"’ 


d / ^z(t) 
dt ^ a 


)= (x(t) - x^(t)) 


1 


ft 


aa. 


The set of initial conditions are, 


x(t) = \i.^ + [12 '^ 
5jlL'^ ) = 1 


a 

9 z( t) 

a ^2 


IxLt) 
a a^ 

a x( t ) 
a ^2 

9z(Q-) 

a m 


= t 


0 


= 0 


•1 ^ t ^ o 


az(o) 

91-^2 


a z(o ) _ a_^o) 


aa. 


a a. 


= 0 


+ x(t-1 ) 


¥e choose T to be 9 units (= 90 mts)* 
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120 



FIG.V.1 DEVIATION IN THE WEIGHT COMPOSITION OF 
REACTANT -A 
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Using the iteration scheme presented in the previous section 
with constant acceleration factor C = -1 and initial guess, 

0.1 , ^2 0 . 0 , cc ^ — — 0.1 , 0^2 — 0.0 

¥e obtain, 


[1^ = 0.06816877 , 

= -0.2113325 , 
for a gradient, 


azd) 

9 

3z(T ) 

9a^ 


0.0000248, 

-0.0000547, 


^2 = -0.01644707 
a2 = -0.09254916 

= - 0.0001132 

o ^2 

= - 0.0000906 

O 0^0 


and the functional value is obtained as ,* J = 0.00004000576. 

The system response is shown in figure (7.1). 

5. CONCIUSIOU 

In this chapter we have considered the problem of initial 
function and parameter determination for a system of DDE with 
single constant delay, minimizing a given functional of system 
variables. The results can be extended directly to multiple 
time varying delays when the delays vary continuously with time. 
The method can be generalized to more complex systems as well. 

In the derivation of the results the function f is assumed to be 
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continuous in t. With suitable modifications in the deriva- 
tions the class of functions f can be extended to incorporate 
functions satisfying Caratheodory assumptions in t; 

The necessary conditions are derived for pC Z C C^[ -1 , 0] ; Z 
a finite dimensional subspace of C^[-1,0]. A near-optimal so- 
lution in C^[-1,0j is obtained if the dimension of Z is chosen 
sufficiently, large. The increase in dimension of Z increases 
the number of parameters which on the other hand increases 
the order of the system of associated equations to be solved in 
each step of the iteration scheme for the determination of the 
gradient of J. Thus the dimension of the subspace Z cannot be 
increased arbitrarily as the computation time required in that 
case will be enormous. The choice of the set of vectors 
{ e^ : i = 1 ,2 , . . . , 1 } in such problems plays an important 
role, as for the same dimension of the subspace Z, one obtains 
different minimum values of J for different sets of vectors 
{ e^^ : i = 1)2, ..., 1} . Thus the set of vectors { 1,2,,..,1} 
should be judiciously chosen depending on the nature of the 


system. 
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